-- Logs begin at Fri 2022-06-17 06:34:13 UTC, end at Fri 2022-06-17 07:38:14 UTC. -- Jun 17 07:11:08.555983 dv-cinder-834822-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 07:11:08.566614 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:11:08 2022] *** Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: nodename: dv-cinder-834822-4-iscsi Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: machine: x86_64 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: clock source: unix Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: pcre jit disabled Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: detected number of CPU cores: 4 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: current working directory: / Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: your processes number limit is 47680 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: your memory page size is 4096 bytes Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: detected max file descriptor number: 2048 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: lock engine: pthread robust mutexes Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: thunder lock: enabled Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 07:11:08.567159 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:11:08.610594 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: Python main interpreter initialized at 0x5594a4f1e9c0 Jun 17 07:11:08.610594 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: python threads support enabled Jun 17 07:11:08.610594 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: your server socket listen backlog is limited to 100 connections Jun 17 07:11:08.610594 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:11:08.610981 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:11:08.610981 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: *** Operational MODE: preforking *** Jun 17 07:11:08.611246 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:11:08.611246 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: spawned uWSGI master process (pid: 103028) Jun 17 07:11:08.611420 dv-cinder-834822-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 07:11:08.612693 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: spawned uWSGI worker 1 (pid: 103029, cores: 1) Jun 17 07:11:08.612693 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: spawned uWSGI worker 2 (pid: 103030, cores: 1) Jun 17 07:11:08.612693 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:11:09.262746 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:11:09.263744 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:11:10.425560 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:11:10.425560 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: from cryptography.utils import int_from_bytes Jun 17 07:11:10.426172 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:11:10.426172 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: from cryptography.utils import int_from_bytes Jun 17 07:11:10.432564 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:11:10.432564 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: from cryptography.utils import int_from_bytes Jun 17 07:11:10.433012 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:11:10.433012 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: from cryptography.utils import int_from_bytes Jun 17 07:11:12.979898 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:11:12.980581 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:11:12.980927 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:11:12.981021 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:11:12.981114 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:11:12.981194 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:11:12.981281 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:11:12.981379 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:11:12.981459 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:11:12.981536 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:11:12.981675 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.981812 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982009 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982102 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982335 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982423 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982658 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982746 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.982991 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983079 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983306 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983394 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983629 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983716 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.983950 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984042 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984306 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984567 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984654 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984884 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.984977 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985210 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-4-iscsi {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985296 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-4-iscsi {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985531 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985627 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985839 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.985924 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986148 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986234 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986467 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986554 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986772 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.986878 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.987091 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.987194 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.987403 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.987500 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.987898 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.988005 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.988383 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.988490 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.988693 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.988793 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.989005 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.989098 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.989341 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.989447 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.989715 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.990310 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.990527 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.990626 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.990850 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.990967 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991166 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991258 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991485 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991568 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991799 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.991908 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992221 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-4-iscsi {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992341 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-4-iscsi {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992540 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992628 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992858 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.992961 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993174 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993270 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993583 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993732 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993897 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.993993 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994209 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994295 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994529 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994629 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994854 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.994950 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995163 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995257 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995491 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995587 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995811 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.995897 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996153 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996255 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996480 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996574 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996782 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.996876 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997091 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997184 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997405 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997495 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997725 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.997810 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998032 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998118 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998337 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998430 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998589 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998675 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998896 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.998982 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999217 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999310 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999538 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999623 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999861 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:12.999960 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000141 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000243 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000398 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000486 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000719 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.000806 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001041 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001140 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001350 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001443 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001659 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001746 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.001968 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002061 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002278 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002386 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002584 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002677 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002890 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.002990 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003195 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003295 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003502 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003599 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003820 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.003919 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004156 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004259 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004485 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004575 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004794 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.004903 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005113 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005211 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005541 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005631 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005797 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.005888 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006106 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006209 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006445 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006535 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006765 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.006854 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007087 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007192 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007393 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007483 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007716 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.007811 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008036 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008144 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008361 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008450 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008669 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008757 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.008987 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009075 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009319 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009408 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009622 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009710 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009868 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.009962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010173 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010261 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010478 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010578 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010796 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.010884 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011102 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011200 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011408 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011560 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011707 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011850 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.011995 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012155 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012324 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012547 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012692 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012826 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.012959 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013092 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013245 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013389 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013524 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013810 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.013945 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014079 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014232 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014390 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014540 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014675 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014816 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.014998 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015150 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015319 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015472 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015608 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015740 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.015916 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016131 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016274 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016420 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016564 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016699 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.016855 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017004 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017161 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017309 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017472 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017614 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017793 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.017986 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018138 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018282 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018424 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018558 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018700 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018835 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.018977 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019112 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019284 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019426 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019600 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019747 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.019882 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.020033 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.020223 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.020362 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.020512 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.020648 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.021328 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.021476 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.021651 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.021790 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.021956 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022098 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022241 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022374 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022549 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022700 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022835 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.022967 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023140 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023282 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023443 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023592 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023734 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.023867 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024046 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024210 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024379 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024541 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024677 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024808 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.024980 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025131 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025274 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025419 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025587 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025731 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:11:13.025921 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026062 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026255 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026406 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026597 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026737 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.026911 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027061 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027243 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027386 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027573 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027714 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.027891 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028031 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028219 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028356 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028532 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028682 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.028861 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.029260 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.029407 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.029541 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.029723 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.029865 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030034 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030183 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030355 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030498 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030678 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.030842 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031010 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031153 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031328 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031471 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031647 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031790 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.031967 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032175 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032319 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032466 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032602 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032746 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.032936 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033087 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033255 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033396 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033566 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033707 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.033905 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034120 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034267 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034401 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034542 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034686 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.034858 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035010 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035180 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035322 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035491 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035631 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035783 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.035929 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.036120 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.036264 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.036472 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.037148 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.037360 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.037503 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.037679 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.037819 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038001 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038142 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038318 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038459 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038630 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038779 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.038942 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039083 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039255 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039413 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039557 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039691 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.039892 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040057 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040238 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040382 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040540 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040682 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.040854 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041009 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041174 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041315 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041468 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041602 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041785 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.041937 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042098 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042238 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042403 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042551 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042708 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.042857 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043015 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043157 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043327 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043480 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043623 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043757 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.043941 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044120 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044297 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044438 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044611 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044752 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.044944 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045093 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045238 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045395 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045541 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045683 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045848 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.045990 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046158 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046301 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046467 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046615 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046780 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.046934 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047093 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047243 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047390 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047523 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047715 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.047859 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048028 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048232 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048370 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048509 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048680 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048831 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.048990 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049139 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049285 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049428 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049599 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049742 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.049911 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050065 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050224 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050365 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050539 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050680 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.050851 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051000 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051176 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051335 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051483 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051624 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051795 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.051946 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052182 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052328 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052522 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052670 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052825 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.052961 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053148 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053299 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053474 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053623 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053794 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.053936 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054102 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054243 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054414 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054563 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054707 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.054840 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055016 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055159 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055325 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055484 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055621 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055755 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.055929 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056127 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056270 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056416 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056552 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056685 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056850 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.056993 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057160 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057331 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057489 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057625 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057769 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.057903 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058083 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058227 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058389 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058529 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058697 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.058848 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059043 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059185 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059347 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059492 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059683 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.059826 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060020 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060190 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060372 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060515 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060701 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.060842 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061018 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061167 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061337 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061488 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061653 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061803 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.061967 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062108 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062280 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062421 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062595 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062753 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.062919 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063061 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063231 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063372 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063553 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063770 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.063907 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064053 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064232 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064366 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064502 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064648 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064817 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.064966 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065109 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065243 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065429 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065590 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065772 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.065913 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066110 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066251 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066431 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066581 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066755 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.066903 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067075 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067218 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067433 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067584 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067773 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.067914 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068110 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068258 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068433 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068584 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068748 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.068888 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069071 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069211 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069385 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069527 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069709 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.069862 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070022 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070163 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070349 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070492 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070662 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070810 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.070982 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071147 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071290 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071431 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071596 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071752 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.071905 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072053 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072268 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072418 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072584 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072732 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.072902 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073063 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073212 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073353 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073521 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073671 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073833 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.073991 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074133 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074274 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074414 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074556 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074705 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.074854 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075003 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075145 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075324 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075472 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075629 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075780 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.075949 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076198 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076355 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076496 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076647 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076789 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.076936 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077084 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077226 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077367 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077516 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077816 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.077958 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078098 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078247 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078390 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078531 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078671 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078812 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.078952 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079101 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079243 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079383 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079524 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079682 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079824 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.079974 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080165 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080323 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080473 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080614 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080755 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.080906 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081055 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081196 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081362 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081511 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081676 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081819 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.081961 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082119 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082263 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082404 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082577 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082728 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.082894 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.083043 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.083214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.083860 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084033 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084359 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084501 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084688 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084845 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.084997 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085149 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085297 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085439 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085588 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085744 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.085893 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086053 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086197 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086338 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086480 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086629 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086808 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.086958 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087108 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087250 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087399 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087550 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087714 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.087864 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088015 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088198 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088343 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088492 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088657 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.088806 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.089225 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.089383 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.089560 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.089710 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.089881 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090029 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090205 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090355 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090529 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090680 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090852 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.090999 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.091183 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.091331 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.091515 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.091665 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.091863 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092162 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092328 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092491 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092634 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092775 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.092926 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093068 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093210 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093351 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093492 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093642 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093793 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.093934 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094076 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094217 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094378 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094521 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094671 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094813 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.094954 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095094 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095243 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095392 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095548 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095690 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095831 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.095979 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096144 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096316 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096461 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096611 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096754 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.096894 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097034 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097183 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097332 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097483 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097638 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097791 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.097933 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098093 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098243 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098385 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098526 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098668 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098809 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.098958 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.099623 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.099765 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.099975 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100150 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100335 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100496 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100683 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100844 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.100994 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101156 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101304 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101466 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101632 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101794 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.101942 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102104 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102251 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102413 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102559 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102721 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.102870 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103035 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103182 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103331 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103491 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103640 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103805 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.103955 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104140 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104297 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104456 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104611 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104766 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.104925 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105071 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105232 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105382 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105543 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105688 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105861 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.105997 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106166 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106303 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106476 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106610 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106781 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.106916 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107087 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107229 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107400 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107541 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107709 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.107848 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108019 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108187 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108372 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108518 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108664 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108799 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.108987 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109124 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109297 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109440 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109611 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109747 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.109917 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110053 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110230 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110375 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110542 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110689 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110849 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.110984 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111162 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111298 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111470 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111605 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111776 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.111913 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112118 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112259 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112393 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112524 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112701 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.112837 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113005 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113141 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113325 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113477 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113637 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113779 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.113946 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114090 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114250 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114393 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114539 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114711 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.114882 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115025 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115187 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115328 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115494 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115645 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115781 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.115916 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116093 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116235 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116404 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116568 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116722 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.116866 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117008 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117150 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117299 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117519 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117666 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117808 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.117949 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118091 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118242 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118383 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118536 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118678 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118819 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.118966 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119121 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119263 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119405 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119553 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119734 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.119882 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120033 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120232 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120378 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120541 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120686 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120828 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.120982 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121125 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121266 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121407 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121571 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121730 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.121873 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122013 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122180 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122330 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122486 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122641 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122786 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.122928 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123069 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123211 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123382 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123543 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123687 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123837 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.123980 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124144 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124325 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124491 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124635 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124776 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.124960 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125117 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125259 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125411 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125560 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125703 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125844 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.125996 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126146 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126298 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126439 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126581 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126722 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.126874 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127031 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127174 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127315 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127457 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127630 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127780 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.127936 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128113 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128272 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128425 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128569 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128717 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.128868 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129011 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129154 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129295 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129436 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129586 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129729 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.129870 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130042 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130239 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130389 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130546 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130834 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.130975 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131116 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131257 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131407 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131550 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131691 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.131954 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132132 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132297 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132439 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132721 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.132892 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133051 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133202 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133345 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133515 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133673 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133836 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.133986 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134146 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134295 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134437 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134578 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134824 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.134979 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135136 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135277 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135448 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135598 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135747 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.135890 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136039 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136246 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136391 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136543 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136685 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136836 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.136985 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137126 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137267 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137416 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137560 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137714 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.137865 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138020 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138172 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138321 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138463 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138614 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138756 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.138897 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139148 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139295 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139462 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139619 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139763 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.139904 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140195 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140350 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140504 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140647 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140810 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.140972 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141118 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141266 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141443 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141601 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141751 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.141900 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142043 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142197 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142432 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142585 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142737 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.142892 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143034 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143175 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143316 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143458 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143607 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143750 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.143898 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144041 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144250 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144394 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144547 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144691 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144846 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.144989 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.145131 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.145283 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.145425 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.145575 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.145834 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.146475 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.146655 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.146813 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.146958 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147100 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147278 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147428 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147605 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147764 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.147907 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148049 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148224 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148368 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148511 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148675 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148819 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.148969 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149113 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149254 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149405 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149549 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149699 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.149843 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150016 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150168 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150319 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150463 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150615 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150758 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.150899 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151048 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151215 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151360 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151501 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151650 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151792 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.151935 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152120 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152271 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152441 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152601 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152754 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.152906 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153076 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153227 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153392 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153542 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153692 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.153846 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154251 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154393 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154542 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154702 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154845 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.154996 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155139 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155294 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155436 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155576 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155761 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.155919 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156095 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156244 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156397 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156540 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156764 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.156909 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157051 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157192 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157334 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157474 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157668 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157819 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.157988 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158136 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158310 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158459 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158633 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158795 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.158945 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159086 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159228 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159379 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159529 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159673 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159814 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.159956 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160132 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160291 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160434 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160588 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160737 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.160887 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161037 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161193 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161346 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161540 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161691 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161833 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.161974 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162125 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162268 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162416 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162568 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162711 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.162866 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163009 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163173 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163324 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163487 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163648 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163800 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.163943 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164133 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164281 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164424 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164579 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164734 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.164875 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165212 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165384 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165531 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165711 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.165860 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166016 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166157 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166331 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166489 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166642 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166783 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.166956 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167107 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167274 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167429 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167572 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167719 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.167892 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168053 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168226 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168380 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168523 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168672 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168840 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.168990 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169155 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169312 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169454 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169602 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169772 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.169922 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.170095 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.170298 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.170621 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.170781 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.170930 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171074 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171228 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171371 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171540 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171696 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171847 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.171989 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172200 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172356 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172498 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172639 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172798 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.172948 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173099 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173241 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173382 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173531 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173673 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.173822 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174160 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174333 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174482 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174662 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174820 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.174964 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175105 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175285 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175441 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175606 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175768 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.175911 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176052 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176265 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176430 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176595 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176737 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.176882 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.177023 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.177936 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178091 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178235 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178378 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178526 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178677 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178819 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.178981 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179133 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179276 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179418 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179559 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179701 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179851 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.179994 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180192 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180336 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180479 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180620 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180778 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.180938 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181081 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181222 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181363 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181513 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181655 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181797 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.181937 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182079 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182266 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182372 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182465 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182624 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182711 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.182943 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.183145 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.183467 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.183619 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.183769 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.183911 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184134 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184305 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184449 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184589 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184768 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.184928 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185070 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185219 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185397 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185547 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185697 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185838 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.185978 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186196 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186340 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186489 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186631 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186785 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.186927 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187077 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187220 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187361 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187502 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187650 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187806 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.187950 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188292 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188434 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188575 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188740 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.188914 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.189248 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.189401 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.189550 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.189691 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.189882 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190034 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190210 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190360 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190530 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190698 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190843 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.190999 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191148 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191295 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191437 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191585 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191734 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.191877 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.192044 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.192312 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.192461 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.192617 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.192811 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.193457 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.193615 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.193758 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.193899 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194048 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194199 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194348 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194499 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194641 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194790 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.194934 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195098 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195247 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195399 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195540 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195690 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195832 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.195973 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196161 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196310 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196453 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196610 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196753 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.196895 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197043 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197184 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197344 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197496 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197646 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197796 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.197937 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198229 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198379 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198521 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198662 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198804 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.198944 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199095 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199247 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199389 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199530 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199671 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199812 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.199962 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200127 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200276 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200429 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200571 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200712 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.200863 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201005 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201160 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201301 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201450 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201592 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201742 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.201890 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202033 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202207 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202358 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202509 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202651 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.202853 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.203003 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.203154 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.203296 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.203501 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.203698 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204034 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204210 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204383 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204541 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204694 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.204842 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205036 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205186 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205338 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205487 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205631 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205772 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.205921 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206071 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206247 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206409 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206553 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206695 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.206866 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207016 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207180 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207350 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207494 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207634 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207776 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.207927 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208094 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208255 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208425 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208570 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208736 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.208894 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209045 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209196 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209338 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209480 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209642 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209792 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.209948 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210089 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210240 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210382 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210546 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210696 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.210848 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211002 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211192 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211343 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211510 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211667 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211810 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.211952 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212160 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212323 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212467 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212617 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212760 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.212901 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213074 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213232 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213383 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213534 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213676 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213818 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.213964 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214142 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214305 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214452 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214593 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214735 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.214894 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215046 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215296 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215449 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215626 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215768 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.215909 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216050 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216245 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216396 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216539 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216688 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.216862 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217033 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217180 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217321 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217487 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217642 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217785 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.217933 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218111 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218260 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218444 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218595 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218773 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.218946 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219096 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219239 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219380 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219520 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219674 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219817 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.219958 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220155 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220307 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220449 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220599 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220741 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.220894 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221043 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221219 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221367 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221521 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221670 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221812 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.221960 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222101 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222242 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222393 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222534 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222686 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222828 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.222969 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223118 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223268 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223410 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223552 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223693 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.223840 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224020 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224192 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224335 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224478 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224631 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224772 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.224929 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225073 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225214 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225356 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225498 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225641 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225791 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.225941 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226083 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226223 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226364 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226523 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226667 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226809 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.226951 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227093 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227235 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227413 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227571 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227715 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.227863 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228042 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228261 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228415 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228569 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228712 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.228860 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229003 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229144 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229294 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229436 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229600 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229759 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.229943 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230102 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230245 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230546 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230688 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230838 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.230988 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231131 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231272 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231413 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231554 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231722 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.231882 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232025 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232199 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232352 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232504 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232656 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232798 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.232987 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233138 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233302 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233452 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233631 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233789 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.233954 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234104 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234265 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234408 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234583 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234733 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.234882 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235025 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235206 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235363 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235507 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235648 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235817 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.235968 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236171 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236330 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236474 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236616 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236756 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.236898 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237076 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237236 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237379 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237520 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237698 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.237853 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238024 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238191 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238335 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238476 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238649 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238797 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.238975 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.239123 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.239302 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.239450 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240161 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240324 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240482 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240623 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240832 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.240982 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241148 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241304 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241456 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241598 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241761 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.241910 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.242052 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:11:13.242203 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:11:13.242346 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:11:13.304754 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO dbcounter [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Registered counter for database nova_api Jun 17 07:11:13.304969 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO dbcounter [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Registered counter for database nova_api Jun 17 07:11:13.325165 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_db.sqlalchemy.engines [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.327627 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.331710 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writer thread running {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.334248 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writer thread running {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.388251 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.context [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744af3b0-8bca-4736-b26d-6b2b0eb936d0(cell1) {{(pid=103030) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:11:13.390823 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.context [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744af3b0-8bca-4736-b26d-6b2b0eb936d0(cell1) {{(pid=103029) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:11:13.392425 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_concurrency.lockutils [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:11:13.394021 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_concurrency.lockutils [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:11:13.394832 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_concurrency.lockutils [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:11:13.395001 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:11:13.396504 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:11:13.396901 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_concurrency.lockutils [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:11:13.397299 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:11:13.398900 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO dbcounter [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Registered counter for database nova_cell0 Jun 17 07:11:13.399278 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:11:13.401370 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO dbcounter [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Registered counter for database nova_cell0 Jun 17 07:11:13.402797 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO dbcounter [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Registered counter for database nova_cell1 Jun 17 07:11:13.405647 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO dbcounter [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Registered counter for database nova_cell1 Jun 17 07:11:13.410442 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_db.sqlalchemy.engines [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.413612 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_db.sqlalchemy.engines [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.414622 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.417847 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writer thread running {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.419149 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writer thread running {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.555689 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writer thread running {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.557342 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.562021 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writer thread running {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.565592 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO dbcounter [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Registered counter for database nova_cell0 Jun 17 07:11:13.570881 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO dbcounter [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Registered counter for database nova_cell0 Jun 17 07:11:13.574391 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG oslo_db.sqlalchemy.engines [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.578704 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writer thread running {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.579442 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_db.sqlalchemy.engines [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:11:13.583683 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writer thread running {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:11:13.914184 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: WARNING keystonemiddleware.auth_token [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:11:13.917619 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: WARNING keystonemiddleware.auth_token [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:11:13.921250 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: WARNING keystonemiddleware.auth_token [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:11:13.924827 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: WARNING keystonemiddleware.auth_token [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:11:14.261636 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: WARNING keystonemiddleware.auth_token [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:11:14.266753 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: WARNING keystonemiddleware.auth_token [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:11:14.267554 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: WARNING keystonemiddleware.auth_token [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:11:14.273264 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: WARNING keystonemiddleware.auth_token [None req-da7608af-b73b-494e-b2ae-3ab16b2217e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:11:14.273397 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594a4f1e9c0 pid: 103029 (default app) Jun 17 07:11:14.275448 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:11:14.276706 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jun 17 07:11:14.277110 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Fri Jun 17 07:11:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:11:14.278649 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594a4f1e9c0 pid: 103030 (default app) Jun 17 07:12:29.616002 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:29.617044 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jun 17 07:12:29.617454 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:29.629157 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_api:SELECT=3 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:29.630112 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_cell1:SELECT=3 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:29.631646 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_cell0:SELECT=3 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:29.632416 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:30.062755 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-4ddfcf7f-3c3c-4ba6-9bd8-97d25a2a9b9a admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:30.093123 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-4ddfcf7f-3c3c-4ba6-9bd8-97d25a2a9b9a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469157 Jun 17 07:12:30.094063 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jun 17 07:12:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:32.264429 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:32.265360 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-5df627e5-6ab1-4fe1-9860-647be4585a0c None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 17 07:12:32.265770 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:32.331764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-1b68abdc-412e-4d7d-91c9-acabcde721e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:32.351622 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:12:32.351622 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: warnings.warn(msg) Jun 17 07:12:32.378842 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-1b68abdc-412e-4d7d-91c9-acabcde721e0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105813 Jun 17 07:12:32.379514 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:32.598505 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-b8297854-d5fc-472a-8670-e48029bf4f3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:32.600959 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:12:32.600959 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:12:32.616654 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_api:SELECT=3 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:32.617114 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_cell0:SELECT=3 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:32.617915 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_cell1:SELECT=3 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:32.618620 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:32.668318 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-b8297854-d5fc-472a-8670-e48029bf4f3c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279927 Jun 17 07:12:32.668918 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jun 17 07:12:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:34.863185 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-1b68abdc-412e-4d7d-91c9-acabcde721e0 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:34.864177 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-1b68abdc-412e-4d7d-91c9-acabcde721e0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 17 07:12:34.864605 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:34.992963 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-6014128a-5eeb-4b74-8244-4b870318a0d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:35.011004 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:12:35.011004 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:12:35.029467 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-6014128a-5eeb-4b74-8244-4b870318a0d1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158394 Jun 17 07:12:35.030021 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:35.042248 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-9beb61cf-5732-4b7b-a0a1-a723251a7a16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:35.043749 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:12:35.043749 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: warnings.warn(msg) Jun 17 07:12:35.075092 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-9beb61cf-5732-4b7b-a0a1-a723251a7a16 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036489 Jun 17 07:12:35.075666 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jun 17 07:12:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:37.248752 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-6014128a-5eeb-4b74-8244-4b870318a0d1 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:37.249788 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-6014128a-5eeb-4b74-8244-4b870318a0d1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 17 07:12:37.250451 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:37.311242 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-7aabcb19-98ac-4dd1-aaa0-2c8689603783 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:37.329938 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-7aabcb19-98ac-4dd1-aaa0-2c8689603783 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073438 Jun 17 07:12:37.336167 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:37.345131 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-2f0df4de-cc45-4ca5-8d8e-cbd67c94878a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:37.369080 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-2f0df4de-cc45-4ca5-8d8e-cbd67c94878a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027622 Jun 17 07:12:37.369805 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jun 17 07:12:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:39.545185 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-7aabcb19-98ac-4dd1-aaa0-2c8689603783 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:39.546228 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-7aabcb19-98ac-4dd1-aaa0-2c8689603783 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 17 07:12:39.546629 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:39.603845 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-c75b51d7-3529-47f6-9937-eb5261a32910 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:39.621399 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-c75b51d7-3529-47f6-9937-eb5261a32910 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069074 Jun 17 07:12:39.621941 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:12:39.634341 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-6aef7c58-bc02-4fca-82f6-c5ea92f7dd4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:39.659052 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-6aef7c58-bc02-4fca-82f6-c5ea92f7dd4f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028939 Jun 17 07:12:39.659570 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jun 17 07:12:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:41.843649 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-c75b51d7-3529-47f6-9937-eb5261a32910 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:41.844756 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-c75b51d7-3529-47f6-9937-eb5261a32910 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 17 07:12:41.845335 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:41.906628 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:41.925370 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073049 Jun 17 07:12:41.932354 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:41.938603 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-5eef80cb-3fda-49ff-94d0-e75ae58cd142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:41.962046 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-5eef80cb-3fda-49ff-94d0-e75ae58cd142 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027647 Jun 17 07:12:41.965212 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jun 17 07:12:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:12:44.135514 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:44.136577 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 17 07:12:44.137138 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:44.197696 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-7c613546-74f0-4f55-b71e-f742ed0c8533 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:44.224310 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-7c613546-74f0-4f55-b71e-f742ed0c8533 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081226 Jun 17 07:12:44.225378 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jun 17 07:12:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:12:46.430293 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:46.431359 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-f3c7fde2-5024-4a3c-868c-04e6e50692b4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 17 07:12:46.431787 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:46.497263 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-469cd764-6f14-48b4-bc62-2bb6fa4c222f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "1", "name": "m1.tiny"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:46.515395 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-469cd764-6f14-48b4-bc62-2bb6fa4c222f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077708 Jun 17 07:12:46.515953 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:46.528699 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-82cfaf8c-8b1b-4267-bd8b-04c7dcef0c09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:46.551922 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-82cfaf8c-8b1b-4267-bd8b-04c7dcef0c09 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027017 Jun 17 07:12:46.552557 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jun 17 07:12:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:48.760841 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-469cd764-6f14-48b4-bc62-2bb6fa4c222f admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:48.762858 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-469cd764-6f14-48b4-bc62-2bb6fa4c222f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002917 Jun 17 07:12:48.763669 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:48.828057 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-5b76a8c2-7d90-4c14-ac5a-27c2b49fa9dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "rxtx_factor": 1.0}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:48.847159 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-5b76a8c2-7d90-4c14-ac5a-27c2b49fa9dc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077424 Jun 17 07:12:48.847749 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:12:48.859856 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-dcd528a7-0ff2-42bf-bbbe-c4628a52636e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:48.883704 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-dcd528a7-0ff2-42bf-bbbe-c4628a52636e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027543 Jun 17 07:12:48.884531 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jun 17 07:12:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:51.069030 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-5b76a8c2-7d90-4c14-ac5a-27c2b49fa9dc admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:51.070063 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-5b76a8c2-7d90-4c14-ac5a-27c2b49fa9dc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jun 17 07:12:51.070466 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:12:51.139081 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-218fa846-3e7f-4643-ab4b-868a553c2345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "id": "3", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:51.156929 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-218fa846-3e7f-4643-ab4b-868a553c2345 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080529 Jun 17 07:12:51.157478 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:51.169871 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-534e0c7b-e187-492d-ab8b-bde589e48b9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:51.192450 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-534e0c7b-e187-492d-ab8b-bde589e48b9c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026249 Jun 17 07:12:51.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jun 17 07:12:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:53.321792 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-218fa846-3e7f-4643-ab4b-868a553c2345 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:53.322821 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-218fa846-3e7f-4643-ab4b-868a553c2345 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 17 07:12:53.323234 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:53.391373 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-ab964bda-c4ab-4bff-9e6c-8015c06d3ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:53.406558 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-ab964bda-c4ab-4bff-9e6c-8015c06d3ba0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076868 Jun 17 07:12:53.407106 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:53.418969 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-50a5a3d4-57d0-4f63-8b62-ffa75c7d6660 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:53.442117 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-50a5a3d4-57d0-4f63-8b62-ffa75c7d6660 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026756 Jun 17 07:12:53.442819 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jun 17 07:12:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:55.613990 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-ab964bda-c4ab-4bff-9e6c-8015c06d3ba0 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:12:55.615142 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-ab964bda-c4ab-4bff-9e6c-8015c06d3ba0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 17 07:12:55.615693 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:12:55.679656 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:55.700507 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078808 Jun 17 07:12:55.701074 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jun 17 07:12:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:12:55.712951 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-5cb92697-adfc-4ba1-a7aa-c3be11caa704 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:12:55.736091 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-5cb92697-adfc-4ba1-a7aa-c3be11caa704 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026754 Jun 17 07:12:55.736688 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jun 17 07:12:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:19.796744 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:19.797759 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 17 07:13:19.798152 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:19.808411 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:19.856891 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-c35f1e64-60a1-41c8-8f6a-02b70d9e532f admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:19.873992 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-c35f1e64-60a1-41c8-8f6a-02b70d9e532f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070186 Jun 17 07:13:19.874525 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jun 17 07:13:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:20.832771 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:20.833821 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-ae50c419-8ac2-457b-8ce2-e4803bb202c1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jun 17 07:13:20.834221 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:21.023890 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-131471a5-5a4b-408b-a685-15a344bf134b admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:21.029585 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.wsgi [None req-131471a5-5a4b-408b-a685-15a344bf134b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-131471a5-5a4b-408b-a685-15a344bf134b admin admin] Request method failure captured: Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept: application/json Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept-Encoding: gzip, deflate Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Connection: keep-alive Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Content-Length: 0 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Host: 10.222.0.33 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-System-Scope: None Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: User-Agent: python-novaclient Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Auth-Token: gAAAAABirCmQ4zoEtA8kNjuNUmKcHaXmupQSSTJ4b1QEGvKtajD6CwCQ6kdlB0Mbe4qu6gPS0BxG1Dhi4ysTPKFkJmtCNaleM6-QaU89Ob0_Qju-Yc3DSt2IUxbCX_ukdaLQggYyM21OJBM5gAY09tEqJtEiTAofn2WoXxQH6gupqGz0eB_J6pk Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Id: None Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Name: None Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Identity-Status: Confirmed Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Is-Admin-Project: True Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Id: default Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Name: Default Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Name: admin Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Role: admin,reader,member Jun 17 07:13:21.032883 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Roles: admin,reader,member Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant: admin Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Name: admin Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User: admin Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Id: default Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Name: Default Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Name: admin Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: method: > Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: exception: Flavor 42 could not be found. Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: action_args: {'id': '42'} Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:21.034555 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:21.035764 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.036962 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-131471a5-5a4b-408b-a685-15a344bf134b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:21.038586 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-131471a5-5a4b-408b-a685-15a344bf134b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061660 Jun 17 07:13:21.038586 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jun 17 07:13:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:13:21.044677 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-e5f010a9-19dc-423a-ba04-2bd737f96246 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:21.047529 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:21.067131 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-e5f010a9-19dc-423a-ba04-2bd737f96246 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026139 Jun 17 07:13:21.067672 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:13:21.077380 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-16261dfe-77da-4001-9592-79490a014da4 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:21.098314 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-16261dfe-77da-4001-9592-79490a014da4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024430 Jun 17 07:13:21.098834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:21.108931 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-e5c6abf1-bde0-4a51-af69-ace5a5abb536 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:21.114927 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.wsgi [None req-e5c6abf1-bde0-4a51-af69-ace5a5abb536 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-e5c6abf1-bde0-4a51-af69-ace5a5abb536 admin admin] Request method failure captured: Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept: application/json Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept-Encoding: gzip, deflate Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Connection: keep-alive Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Content-Length: 0 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Host: 10.222.0.33 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-System-Scope: None Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: User-Agent: python-novaclient Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Auth-Token: gAAAAABirCmQ4zoEtA8kNjuNUmKcHaXmupQSSTJ4b1QEGvKtajD6CwCQ6kdlB0Mbe4qu6gPS0BxG1Dhi4ysTPKFkJmtCNaleM6-QaU89Ob0_Qju-Yc3DSt2IUxbCX_ukdaLQggYyM21OJBM5gAY09tEqJtEiTAofn2WoXxQH6gupqGz0eB_J6pk Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Id: None Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Name: None Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Identity-Status: Confirmed Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Is-Admin-Project: True Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Id: default Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Name: Default Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Name: admin Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Role: admin,reader,member Jun 17 07:13:21.118777 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Roles: admin,reader,member Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant: admin Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Name: admin Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User: admin Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Id: default Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Name: Default Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Name: admin Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: method: > Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: exception: Flavor 42 could not be found. Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: action_args: {'id': '42'} Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:21.120332 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:21.121402 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:21.122674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-e5c6abf1-bde0-4a51-af69-ace5a5abb536 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:21.124277 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-e5c6abf1-bde0-4a51-af69-ace5a5abb536 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015244 Jun 17 07:13:21.124277 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jun 17 07:13:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 17 07:13:21.983231 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-16261dfe-77da-4001-9592-79490a014da4 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:21.984288 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-16261dfe-77da-4001-9592-79490a014da4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 17 07:13:21.984684 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:22.174674 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-3171617a-f7bf-4d5c-b93b-809f158e80dc admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:22.180521 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.wsgi [None req-3171617a-f7bf-4d5c-b93b-809f158e80dc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-3171617a-f7bf-4d5c-b93b-809f158e80dc admin admin] Request method failure captured: Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept: application/json Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept-Encoding: gzip, deflate Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Connection: keep-alive Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Content-Length: 0 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Host: 10.222.0.33 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-System-Scope: None Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: User-Agent: python-novaclient Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Auth-Token: gAAAAABirCmRmE0VhrPsIJMdxTa3KdmxznS53RvjeDl1gai_zCZz339Q8O9jcrma0LbYR4X81zF8bUQ83R6JJ9OnCzDGdSLg11wuXSkkx0u2tdC2kwyoD586gIs-fWabsdnv4LjW9CbgDAUnwguh6Oi3AXmMumrdsSsLD8vPVI9RS9TSY__JD_4 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Id: None Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Name: None Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Identity-Status: Confirmed Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Is-Admin-Project: True Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Id: default Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Name: Default Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Name: admin Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Role: admin,reader,member Jun 17 07:13:22.182008 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Roles: admin,reader,member Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant: admin Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Name: admin Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User: admin Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Id: default Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Name: Default Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Name: admin Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: method: > Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: exception: Flavor 84 could not be found. Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: action_args: {'id': '84'} Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:22.183530 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:22.184681 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.186062 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-3171617a-f7bf-4d5c-b93b-809f158e80dc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:22.187345 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-3171617a-f7bf-4d5c-b93b-809f158e80dc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060617 Jun 17 07:13:22.187345 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jun 17 07:13:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:13:22.192925 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-827225c3-3f05-4a7f-b567-30a21df95c22 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:22.208014 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-827225c3-3f05-4a7f-b567-30a21df95c22 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018587 Jun 17 07:13:22.208532 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:22.218413 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-fe680dde-c0be-4c1a-8de0-8178d2730514 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:22.232521 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-fe680dde-c0be-4c1a-8de0-8178d2730514 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017584 Jun 17 07:13:22.233046 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:22.241904 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-3c3334c1-c8f3-40b0-ac71-2a4ef78180cc admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:22.247167 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.wsgi [None req-3c3334c1-c8f3-40b0-ac71-2a4ef78180cc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-3c3334c1-c8f3-40b0-ac71-2a4ef78180cc admin admin] Request method failure captured: Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept: application/json Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept-Encoding: gzip, deflate Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Connection: keep-alive Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Content-Length: 0 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Host: 10.222.0.33 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-System-Scope: None Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: User-Agent: python-novaclient Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Auth-Token: gAAAAABirCmRmE0VhrPsIJMdxTa3KdmxznS53RvjeDl1gai_zCZz339Q8O9jcrma0LbYR4X81zF8bUQ83R6JJ9OnCzDGdSLg11wuXSkkx0u2tdC2kwyoD586gIs-fWabsdnv4LjW9CbgDAUnwguh6Oi3AXmMumrdsSsLD8vPVI9RS9TSY__JD_4 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Id: None Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Name: None Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Identity-Status: Confirmed Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Is-Admin-Project: True Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Id: default Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Name: Default Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Name: admin Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Role: admin,reader,member Jun 17 07:13:22.248705 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Roles: admin,reader,member Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant: admin Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Name: admin Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User: admin Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Id: default Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Name: Default Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Name: admin Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: method: > Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: exception: Flavor 84 could not be found. Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: action_args: {'id': '84'} Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:22.250214 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:22.251078 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:22.252135 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-3c3334c1-c8f3-40b0-ac71-2a4ef78180cc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:22.253144 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-3c3334c1-c8f3-40b0-ac71-2a4ef78180cc admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011682 Jun 17 07:13:22.253144 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jun 17 07:13:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:13:23.105980 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-fe680dde-c0be-4c1a-8de0-8178d2730514 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:23.107032 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-fe680dde-c0be-4c1a-8de0-8178d2730514 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 17 07:13:23.107429 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:23.303293 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-4e29f811-810a-4185-8095-8648aacd2eff admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:23.309081 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.wsgi [None req-4e29f811-810a-4185-8095-8648aacd2eff admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-4e29f811-810a-4185-8095-8648aacd2eff admin admin] Request method failure captured: Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept: application/json Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Accept-Encoding: gzip, deflate Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Connection: keep-alive Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Content-Length: 0 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Host: 10.222.0.33 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Openstack-System-Scope: None Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: User-Agent: python-novaclient Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Auth-Token: gAAAAABirCmTiIW2LzxXflKYHJ4Qx1fIr8cdvhGso47Rd7iNWkdWOYyvgnw-J_wYxRerjRaXAcl6gJBrPQO9MwPQjchIOePp-J0ISDoCqgPFRSC8QULrNE6l4CocV28dAhi58N5dS8WVBPmPObfJLtWyCGCJFpNAsbAvvJdTNhTMfRpYAe-U4XQ Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Id: None Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Domain-Name: None Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Identity-Status: Confirmed Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Is-Admin-Project: True Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Id: default Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Domain-Name: Default Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Project-Name: admin Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Role: admin,reader,member Jun 17 07:13:23.310580 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Roles: admin,reader,member Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant: admin Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-Tenant-Name: admin Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User: admin Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Id: default Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Domain-Name: Default Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: X-User-Name: admin Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: method: > Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: exception: Flavor 451 could not be found. Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: action_args: {'id': '451'} Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:23.311834 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:23.312667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.313692 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-4e29f811-810a-4185-8095-8648aacd2eff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:23.314745 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-4e29f811-810a-4185-8095-8648aacd2eff admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059872 Jun 17 07:13:23.314745 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:13:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:13:23.322264 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-4ece995a-1822-4b26-859d-a24a1e47f4b7 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:23.337661 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-4ece995a-1822-4b26-859d-a24a1e47f4b7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019781 Jun 17 07:13:23.338186 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:23.347494 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:23.360794 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016806 Jun 17 07:13:23.361312 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jun 17 07:13:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:13:23.370012 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-131a03f5-093f-46cf-94ab-449c03966d2f admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:23.375221 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.wsgi [None req-131a03f5-093f-46cf-94ab-449c03966d2f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-131a03f5-093f-46cf-94ab-449c03966d2f admin admin] Request method failure captured: Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept: application/json Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Accept-Encoding: gzip, deflate Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Connection: keep-alive Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Content-Length: 0 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Host: 10.222.0.33 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-Api-Version: compute 2.90 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Openstack-System-Scope: None Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: User-Agent: python-novaclient Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Auth-Token: gAAAAABirCmTiIW2LzxXflKYHJ4Qx1fIr8cdvhGso47Rd7iNWkdWOYyvgnw-J_wYxRerjRaXAcl6gJBrPQO9MwPQjchIOePp-J0ISDoCqgPFRSC8QULrNE6l4CocV28dAhi58N5dS8WVBPmPObfJLtWyCGCJFpNAsbAvvJdTNhTMfRpYAe-U4XQ Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Id: None Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Domain-Name: None Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Identity-Status: Confirmed Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Is-Admin-Project: True Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Id: default Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Domain-Name: Default Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Project-Name: admin Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Role: admin,reader,member Jun 17 07:13:23.376751 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Roles: admin,reader,member Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7107699553c04a40be061877b81300e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7107699553c04a40be061877b81300e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7107699553c04a40be061877b81300e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant: admin Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Id: 7107699553c04a40be061877b81300e3 Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-Tenant-Name: admin Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User: admin Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Id: default Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Domain-Name: Default Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Id: 0bf6e418289c4b9c81b349d812dd7d25 Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: X-User-Name: admin Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: method: > Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: exception: Flavor 451 could not be found. Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: action_args: {'id': '451'} Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:13:23.378315 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:23.379256 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: ERROR nova.api.openstack.wsgi Jun 17 07:13:23.380657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-131a03f5-093f-46cf-94ab-449c03966d2f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103029) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:13:23.382476 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-131a03f5-093f-46cf-94ab-449c03966d2f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011561 Jun 17 07:13:23.382476 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:13:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 07:13:24.235227 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:24.236277 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 17 07:13:24.236667 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:24.425183 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-74b59025-c81d-4a57-9ad3-13d88128cac5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:13:24.443061 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-74b59025-c81d-4a57-9ad3-13d88128cac5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068895 Jun 17 07:13:24.443597 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jun 17 07:13:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:13:25.299392 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:25.300438 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 17 07:13:25.300828 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:25.491858 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-87e6fd08-e159-4a24-9fdc-3badd48637ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:13:25.509520 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-87e6fd08-e159-4a24-9fdc-3badd48637ea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070290 Jun 17 07:13:25.510006 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jun 17 07:13:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:13:26.367254 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:26.368309 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 17 07:13:26.368702 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:26.558873 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-fc23d61d-5072-4f87-9c20-026038a22766 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:13:26.575718 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-fc23d61d-5072-4f87-9c20-026038a22766 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069049 Jun 17 07:13:26.576298 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jun 17 07:13:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:13:27.434568 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:27.435573 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 17 07:13:27.435965 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:27.632250 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-ac3ec3fd-d33c-431f-9445-1a306e17f4e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:13:27.649376 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-ac3ec3fd-d33c-431f-9445-1a306e17f4e7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067936 Jun 17 07:13:27.649896 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jun 17 07:13:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:13:28.515105 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:28.516130 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Jun 17 07:13:28.516524 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:13:28.704872 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-fa3e77f3-ea62-4b69-a867-712f5df4ef86 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:13:28.724210 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-fa3e77f3-ea62-4b69-a867-712f5df4ef86 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069716 Jun 17 07:13:28.724737 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Fri Jun 17 07:13:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:14:15.985123 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:15.986133 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-20c1109d-c060-4258-9b44-ddfc25319720 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 17 07:14:15.986548 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jun 17 07:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:14:15.997793 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.045657 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-42b254bb-213d-46ab-95b2-b55096125359 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:16.064504 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-42b254bb-213d-46ab-95b2-b55096125359 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071183 Jun 17 07:14:16.064988 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jun 17 07:14:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:14:16.087862 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-e4bdce72-42bc-427f-bb77-2808043a0770 admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:16.091310 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG dbcounter [-] [103030] Writing DB stats nova_api:SELECT=14 {{(pid=103030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.097044 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-e4bdce72-42bc-427f-bb77-2808043a0770 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013281 Jun 17 07:14:16.097552 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Fri Jun 17 07:14:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:16.109437 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-24a4de80-8287-46d8-8b24-e71db156f155 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:16.116933 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-24a4de80-8287-46d8-8b24-e71db156f155 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010999 Jun 17 07:14:16.117449 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Fri Jun 17 07:14:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:16.128271 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:16.135470 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010576 Jun 17 07:14:16.135976 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Fri Jun 17 07:14:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:16.146629 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-9d9ca515-4f21-498e-8366-0a2c67edfbb2 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:14:16.154524 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-9d9ca515-4f21-498e-8366-0a2c67edfbb2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011237 Jun 17 07:14:16.155043 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Fri Jun 17 07:14:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:17:39.370934 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:39.371950 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 17 07:17:39.372370 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:17:39.528257 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_api:SELECT=6 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:39.638018 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:39.639167 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:17:39.639167 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:17:39.640933 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:39.641405 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:39.642181 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:39.642655 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:39.676040 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-7d7bbae8-4261-4ab2-b57f-25ab8e52e26f admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149199 Jun 17 07:17:39.676614 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:17:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:40.542004 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:40.543032 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 17 07:17:40.543412 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:17:40.738941 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:40.740143 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:17:40.740143 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:17:40.741327 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:40.741768 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:40.742573 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:40.742999 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:40.761878 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-614a441b-a0dc-4cab-8eb1-4050795ce9fe admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074689 Jun 17 07:17:40.762416 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:17:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:52.091097 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:52.092147 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 17 07:17:52.092545 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:17:52.235795 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_cell0:SELECT=4 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.236531 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_cell1:SELECT=4 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.237189 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG dbcounter [-] [103029] Writing DB stats nova_api:SELECT=8 {{(pid=103029) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.286042 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:52.287455 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:17:52.287455 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:17:52.288699 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:52.289144 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:52.289926 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:52.290390 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:52.315279 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-283082ed-7dc4-4ee1-bec2-2a8cd478512c admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084356 Jun 17 07:17:52.315745 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:17:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:17:53.186911 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: DEBUG nova.api.openstack.wsgi [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] Calling method '>' {{(pid=103030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:53.187915 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: INFO nova.api.openstack.requestlog [None req-b7de71ba-9bd7-4bff-b30e-4282f9c333fb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 17 07:17:53.188339 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: [pid: 103030|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jun 17 07:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:17:53.378722 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG nova.api.openstack.wsgi [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] Calling method '>' {{(pid=103029) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:17:53.379873 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 07:17:53.379873 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: warnings.warn(msg) Jun 17 07:17:53.381167 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:53.381655 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:53.382525 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:17:53.382960 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: DEBUG oslo_concurrency.lockutils [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103029) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:17:53.405070 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: INFO nova.api.openstack.requestlog [None req-8beecc0e-8a73-4ae7-bf8f-e8c3e5722287 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076905 Jun 17 07:17:53.405574 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: [pid: 103029|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jun 17 07:17:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:18:50.594624 dv-cinder-834822-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 07:18:50.595140 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: Fri Jun 17 07:18:50 2022 - graceful shutdown triggered... Jun 17 07:18:50.595557 dv-cinder-834822-4-iscsi devstack@n-api.service[103030]: Gracefully killing worker 2 (pid: 103030)... Jun 17 07:18:50.596025 dv-cinder-834822-4-iscsi devstack@n-api.service[103029]: Gracefully killing worker 1 (pid: 103029)... Jun 17 07:18:51.595144 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: worker 1 buried after 1 seconds Jun 17 07:18:51.595144 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: worker 2 buried after 1 seconds Jun 17 07:18:51.595144 dv-cinder-834822-4-iscsi devstack@n-api.service[103028]: goodbye to uWSGI. Jun 17 07:18:51.596631 dv-cinder-834822-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 07:18:51.597197 dv-cinder-834822-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 07:18:51.599992 dv-cinder-834822-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 07:18:51.611608 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:18:51 2022] *** Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: nodename: dv-cinder-834822-4-iscsi Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: machine: x86_64 Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: clock source: unix Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: pcre jit disabled Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: detected number of CPU cores: 4 Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: current working directory: / Jun 17 07:18:51.613638 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: your processes number limit is 47680 Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: your memory page size is 4096 bytes Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: detected max file descriptor number: 2048 Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: lock engine: pthread robust mutexes Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: thunder lock: enabled Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 07:18:51.614392 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:18:51.657436 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: Python main interpreter initialized at 0x55d5972a69c0 Jun 17 07:18:51.657436 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: python threads support enabled Jun 17 07:18:51.657436 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: your server socket listen backlog is limited to 100 connections Jun 17 07:18:51.657436 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:18:51.657850 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:18:51.657850 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: *** Operational MODE: preforking *** Jun 17 07:18:51.658098 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:18:51.658098 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: spawned uWSGI master process (pid: 117384) Jun 17 07:18:51.658303 dv-cinder-834822-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 07:18:51.662497 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: spawned uWSGI worker 1 (pid: 117395, cores: 1) Jun 17 07:18:51.662497 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: spawned uWSGI worker 2 (pid: 117396, cores: 1) Jun 17 07:18:51.662497 dv-cinder-834822-4-iscsi devstack@n-api.service[117384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:18:52.323069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:18:52.324197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 07:18:53.560859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:18:53.560859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: from cryptography.utils import int_from_bytes Jun 17 07:18:53.561491 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:18:53.561491 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: from cryptography.utils import int_from_bytes Jun 17 07:18:53.566430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:18:53.566430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: from cryptography.utils import int_from_bytes Jun 17 07:18:53.566888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:18:53.566888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: from cryptography.utils import int_from_bytes Jun 17 07:18:55.967031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:18:55.967536 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:18:55.967746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:18:55.968223 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:18:55.968433 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:18:55.968769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.969094 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.969421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.969740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.970152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.970571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.970898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.971221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.971554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.971817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.972159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.972487 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-4-iscsi {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.972810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.973118 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.973427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.973745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.974048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.974370 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.974675 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.975174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.976407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.976407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.976407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.976667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.976871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.977191 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.977510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.977823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.978128 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.978428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.978827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-4-iscsi {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.979141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.979452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.980349 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.980734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.981047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.981357 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.981678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.982017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.982310 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.982651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.982901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:18:55.983344 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.983515 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:18:55.983646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.983646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.983895 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:18:55.984044 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.984225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:18:55.984358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.984493 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:18:55.984622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.984749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.984919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985332 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985471 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.985906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.986872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987002 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987758 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.987898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-4-iscsi {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988598 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.988874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989149 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.989880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.990026 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.990245 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.990383 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.990718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.990877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991025 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991348 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.991789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992031 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992645 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992801 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.992969 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.993922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-4-iscsi {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.994914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.995039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.995221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.995346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996729 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.996855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997495 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.997993 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.998130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.998278 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.998418 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.998642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.998779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999006 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999751 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:55.999929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000115 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000453 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000778 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.000930 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.001912 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002400 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.002862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003349 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003654 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.003947 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004446 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004745 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.004886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005486 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005786 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.005928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006076 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006219 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006360 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006530 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.006983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007433 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.007889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008359 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008658 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.008948 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.009854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.010988 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011617 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011765 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.011916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012079 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012381 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.012977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013406 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.013867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.014014 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.014156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.014297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.014451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.014593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.014764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.014923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.015065 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.015205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.015357 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.015499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.015648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.015796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.015947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.016154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.016316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.016465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.016607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.016748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.016898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.017046 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.017199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.017351 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.017492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.017640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.017783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.017932 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.018081 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.018222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.018398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.018580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.018757 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.018907 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.019049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.019197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.019347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.019495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.019636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.019777 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.019919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.020188 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.020357 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.020500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.020640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.020791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.020934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.021108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.021273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.021422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.021591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.021740 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.021936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.022100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.022243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.022383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.022564 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.022713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.022874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.023032 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.023184 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.023326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.023468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.023708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.023865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.024022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.024241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.024418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.024576 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.024725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.024873 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.025033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.025184 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.025325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.025481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.025631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.025774 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.025915 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.026065 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.026208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.026348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.026489 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.026657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.026861 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.027028 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.027181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.027331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.027512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:18:56.027659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.027852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028382 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.028854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029008 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029301 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029443 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.029889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030181 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.030916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031057 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031402 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031552 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.031993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032349 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032500 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.032973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.033866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034008 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034301 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034442 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.034891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.035034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.035175 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.035377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.035535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.035716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036821 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.036970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037282 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037424 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037566 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.037859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038157 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.038909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.039929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.040898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041792 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.041942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.042084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.042238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.042903 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043682 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.043968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044131 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044433 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044727 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.044875 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045165 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045760 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.045909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046060 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046461 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046762 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.046991 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047472 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.047921 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048115 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048277 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048576 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.048867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049621 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049763 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.049913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050645 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.050945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051094 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051728 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.051870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052680 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052821 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.052962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.053140 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.053333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.053491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.053733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.053891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054095 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.054929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.055072 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.055213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.055376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.055583 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.055741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056116 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056560 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.056991 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.057142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.057293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.057470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.057641 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.057818 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.058517 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.058673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.058823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.058973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059416 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059565 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.059913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.060102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.060315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.060749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.060900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061076 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.061975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062124 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062267 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062565 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062714 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.062867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063050 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063508 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063681 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063840 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.063990 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.064192 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.064341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.064483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.064624 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.064773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065252 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065412 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065412 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065682 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.065976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066820 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.066961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067367 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067517 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067800 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.067942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068261 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.068988 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069131 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069282 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069432 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069716 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.069867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070016 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070458 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070761 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.070913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071072 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071366 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.071962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072436 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072588 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.072881 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073476 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073791 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.073932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074074 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074074 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074521 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.074978 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.075867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076372 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076670 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076822 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.076974 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077116 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.077982 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078572 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.078882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079328 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.079891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080831 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.080974 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081307 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081457 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081599 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081754 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.081904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082185 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.082939 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083314 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083472 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083629 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.083922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084653 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084804 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.084957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085099 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.085975 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086845 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.086996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087449 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.087894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088046 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088512 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088665 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088815 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.088965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.089116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.089300 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.089459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.089622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.089852 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090457 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090613 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.090921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091074 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091233 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.091991 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092803 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.092961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093118 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093432 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093737 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.093885 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094508 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094674 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094837 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.094988 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095433 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.095892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.096999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.097932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.098862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099169 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.099951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100436 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100587 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100736 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.100895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101522 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.101971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102435 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102763 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.102920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103078 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.103854 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.104003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.104298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.104458 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.104614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.105887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106185 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106343 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.106947 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107095 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107411 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.107708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108014 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.108861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109175 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109332 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109493 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109800 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.109961 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110120 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.110892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111198 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111354 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.111985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112168 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112469 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112626 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.112932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113387 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.113859 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114181 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114648 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.114952 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115249 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115727 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.115885 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116564 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116720 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.116877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117192 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117507 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.117968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118654 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.118951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119257 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119741 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.119741 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.120041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.120211 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.120361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121834 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.121992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122596 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.122891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.123984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.124354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.124505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.124661 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.124810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.124967 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.125897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.126965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127270 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127580 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.127730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128525 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128798 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.128985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.129290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.129536 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.129707 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.129858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130319 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.130946 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131262 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131729 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.131887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132237 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.132851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133150 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133472 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133777 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.133933 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.134852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135183 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135639 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.135959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136167 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136620 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.136935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137402 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.137886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138501 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138809 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.138957 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139106 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139272 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139650 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.139955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140448 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.140914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141077 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141240 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141401 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141709 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.141865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142792 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.142949 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143098 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143564 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.143712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144009 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144009 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.144949 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145264 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145728 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.145876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146031 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146188 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.146945 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147259 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147427 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.147883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148207 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148674 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.148980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149589 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.149904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150061 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150210 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.150984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151469 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.151959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.152926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.153077 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.153241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.153390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.153559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.153991 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.154929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155391 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.155862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156195 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156652 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.156959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.157955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158572 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158721 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.158869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159472 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.159927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.160119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.160286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.160447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.160597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.160753 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161772 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.161921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162078 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162233 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162546 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.162999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163471 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.163943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164122 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164287 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164437 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.164914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165082 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.165864 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.166957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.167106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.167774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.167942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168477 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.168924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169460 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169766 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.169916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170224 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170531 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170680 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.170992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.171923 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.172109 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.172439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.172439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.172743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.172743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173198 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.173953 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174720 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.174883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175517 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.175983 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176641 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176790 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.176939 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177856 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.177856 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178318 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178624 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.178928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179090 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179396 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179693 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.179852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180671 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.180990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181460 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181774 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.181951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182564 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.182873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.183569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.183724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.183881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184383 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.184854 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185775 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.185938 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186694 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.186856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187153 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187301 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187613 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.187925 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188098 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.188892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189516 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.189963 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190112 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.190899 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191355 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191512 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191512 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191804 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.191953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.192927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193090 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193553 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.193852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194326 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.194951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195582 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.195894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196386 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196536 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196700 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.196850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197008 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197165 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.197948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198097 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198411 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.198977 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.199894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200264 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200588 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.200894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201359 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.201953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202594 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.202891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.203956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204136 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204628 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.204934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205092 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.205844 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206477 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206477 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206771 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.206928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207077 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207382 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.207855 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208550 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208550 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.208999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209304 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209466 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.209922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210556 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.210853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211157 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.211926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212417 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212565 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.212889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213347 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213658 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.213978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214128 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214763 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.214923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215072 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215544 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215544 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.215987 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.216946 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217768 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.217925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218086 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.218875 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219032 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219182 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219804 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.219961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220130 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.220919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221068 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.221838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222000 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222000 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222765 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.222929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223078 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.223847 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224014 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224680 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224837 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.224994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225299 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225459 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.225923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.226094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.226252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.226403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.226403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.226700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227406 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227563 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227800 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.227951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.228143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.228301 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.228463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.228631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.228901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.229065 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.229217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.229366 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.229516 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.229679 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.230358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.230510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.230671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.230820 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.230979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231292 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.231590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.232649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.232649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.232649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.232649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.233230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.233230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.233518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.233809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.234125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.234438 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.234753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.235069 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.235400 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.235733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.236047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.236521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.236892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.237460 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.238117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.238730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.239282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.239610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.239931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.240815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.240815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.241160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.241311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.241526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.241860 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.242194 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.242509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.242840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.243182 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.243540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.243858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.244583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.244583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.244909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.245207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.246116 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:18:56.246370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:18:56.294597 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO dbcounter [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Registered counter for database nova_api Jun 17 07:18:56.310915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO dbcounter [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Registered counter for database nova_api Jun 17 07:18:56.316225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.323360 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writer thread running {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.330810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_db.sqlalchemy.engines [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.338013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writer thread running {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.382205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.context [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744af3b0-8bca-4736-b26d-6b2b0eb936d0(cell1) {{(pid=117395) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:18:56.386364 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:18:56.388439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:18:56.389284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:18:56.391242 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:18:56.393267 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO dbcounter [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Registered counter for database nova_cell0 Jun 17 07:18:56.396591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.context [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),744af3b0-8bca-4736-b26d-6b2b0eb936d0(cell1) {{(pid=117396) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 07:18:56.397140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO dbcounter [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Registered counter for database nova_cell1 Jun 17 07:18:56.400810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:18:56.402906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:18:56.403747 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:18:56.405031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.405773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:18:56.406631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.407820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO dbcounter [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Registered counter for database nova_cell0 Jun 17 07:18:56.411992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO dbcounter [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Registered counter for database nova_cell1 Jun 17 07:18:56.413732 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writer thread running {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.414070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writer thread running {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.419997 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_db.sqlalchemy.engines [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.421350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_db.sqlalchemy.engines [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.427890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writer thread running {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.429230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writer thread running {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.561390 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO dbcounter [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Registered counter for database nova_cell0 Jun 17 07:18:56.568475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_db.sqlalchemy.engines [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.572911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writer thread running {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.576406 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO dbcounter [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Registered counter for database nova_cell0 Jun 17 07:18:56.582892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_db.sqlalchemy.engines [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:18:56.587361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writer thread running {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:18:56.884509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: WARNING keystonemiddleware.auth_token [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:18:56.892095 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: WARNING keystonemiddleware.auth_token [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:18:56.914242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: WARNING keystonemiddleware.auth_token [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:18:56.921456 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: WARNING keystonemiddleware.auth_token [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:18:57.231860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: WARNING keystonemiddleware.auth_token [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:18:57.237796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: WARNING keystonemiddleware.auth_token [None req-5c6313e8-5ece-4f1f-bc3b-a5eb625ebd2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:18:57.243033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5972a69c0 pid: 117395 (default app) Jun 17 07:18:57.266381 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: WARNING keystonemiddleware.auth_token [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 07:18:57.272331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: WARNING keystonemiddleware.auth_token [None req-5e7b23a6-d3ca-4568-adca-1d75050d1e45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 07:18:57.277752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5972a69c0 pid: 117396 (default app) Jun 17 07:19:37.986002 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.986878 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.987802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:37.988556 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.292049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.292870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.298974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:38.299726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:39.439336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8f496140-d2bb-46da-8870-56666c46d074 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Action: 'create', calling method: .version_select at 0x7f8b6f51e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1933764634", "metadata": {"Type": "work"}}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:40.146406 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f9ed4924-be65-4f85-a985-01aab08671fe tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Action: 'create', calling method: .version_select at 0x7f8b6f522790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-271730110", "metadata": {"Type": "work"}}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f9ed4924-be65-4f85-a985-01aab08671fe tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 121 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:40.168222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-271730110", "metadata": {"Type": "work"}}} Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:40.169861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-271730110', 'metadata': {'Type': 'work'}}}} Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:40.170893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:19:40.173176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:19:40.174575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 07:19:40.174575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.174575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f9ed4924-be65-4f85-a985-01aab08671fe tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:40.175947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f9ed4924-be65-4f85-a985-01aab08671fe tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.894361 Jun 17 07:19:40.180810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Jun 17 07:19:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1897 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:19:40.186825 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-29002a3a-09a8-41b6-8add-058679c2a2c3 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Action: 'create', calling method: .version_select at 0x7f8b6f45eaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1287988130", "metadata": {"Type": "work"}}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-29002a3a-09a8-41b6-8add-058679c2a2c3 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 120 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:40.192816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1287988130", "metadata": {"Type": "work"}}} Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:40.194364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1287988130', 'metadata': {'Type': 'work'}}}} Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi '0' Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:40.195338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:19:40.198373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:19:40.199693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 07:19:40.199693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.204738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-29002a3a-09a8-41b6-8add-058679c2a2c3 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:40.205703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-29002a3a-09a8-41b6-8add-058679c2a2c3 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022960 Jun 17 07:19:40.209738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Jun 17 07:19:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:19:40.221672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-84abb33e-ab4f-4590-b3ba-deb5481bf372 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Action: 'create', calling method: .version_select at 0x7f8b6f522790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2078807314", "metadata": {"Type": "work"}}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-84abb33e-ab4f-4590-b3ba-deb5481bf372 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 119 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:40.227444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2078807314", "metadata": {"Type": "work"}}} Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:40.229431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2078807314', 'metadata': {'Type': 'work'}}}} Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise error Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi '' Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:40.230526 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 07:19:40.232319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 07:19:40.233726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 07:19:40.233726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.235929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-84abb33e-ab4f-4590-b3ba-deb5481bf372 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:40.237142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-84abb33e-ab4f-4590-b3ba-deb5481bf372 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023320 Jun 17 07:19:40.237889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Jun 17 07:19:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:19:40.250207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6478f152-4dbb-4c89-9ccb-582c0dde648c tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Calling method '.version_select at 0x7f8b6f44f820>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:40.984450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-6478f152-4dbb-4c89-9ccb-582c0dde648c tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] HTTP exception thrown: Volume tempest-invalid-1601766756 could not be found. Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6478f152-4dbb-4c89-9ccb-582c0dde648c tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1601766756 HTTP/1.1 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:40.989180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Volume tempest-invalid-1601766756 could not be found. Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'tempest-invalid-1601766756'} Jun 17 07:19:40.990764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1601766756 could not be found. (HTTP 404) (Request-ID: req-b0ceea8a-85ad-4865-95b3-97fa3f00f0c6) Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.991584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:19:40.992950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1601766756 could not be found. Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:19:40.994829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1601766756 could not be found. Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1601766756 could not be found. Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6478f152-4dbb-4c89-9ccb-582c0dde648c tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 404 to user: Volume tempest-invalid-1601766756 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6478f152-4dbb-4c89-9ccb-582c0dde648c tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1601766756" status: 404 len: 99 microversion: 2.1 time: 0.750621 Jun 17 07:19:40.996208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1217 bytes} [Fri Jun 17 07:19:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1601766756 => generated 99 bytes in 752 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 17 07:19:41.004844 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-74898192-f30a-47e9-a01b-1f7695101f37 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004698 Jun 17 07:19:41.005346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 5/5] 10.222.0.33 () {58 vars in 1139 bytes} [Fri Jun 17 07:19:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 17 07:19:41.033794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b7b40838-97de-4314-8611-fc152ba5610e tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015367 Jun 17 07:19:41.034348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1136 bytes} [Fri Jun 17 07:19:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 07:19:41.051252 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e26a14fc-aab0-48d9-87a1-00b61f712440 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Calling method '.version_select at 0x7f8b6f37faf0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:41.141707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8f496140-d2bb-46da-8870-56666c46d074 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.168558 Jun 17 07:19:41.143276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 1/7] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Jun 17 07:19:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3172 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 07:19:41.162934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4e7d0bee-da99-4c70-89e4-379cecb35180 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f3ee5e0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:41.179312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-e26a14fc-aab0-48d9-87a1-00b61f712440 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] HTTP exception thrown: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e26a14fc-aab0-48d9-87a1-00b61f712440 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/os-volumes/1f016eb3-fb1f-4266-8966-520101be59d0 HTTP/1.1 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:41.181820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '1f016eb3-fb1f-4266-8966-520101be59d0'} Jun 17 07:19:41.183283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. (HTTP 404) (Request-ID: req-9a932dad-3b60-421f-80c8-3e37353a14b5) Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.184217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:19:41.185527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:19:41.186765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e26a14fc-aab0-48d9-87a1-00b61f712440 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 404 to user: Volume 1f016eb3-fb1f-4266-8966-520101be59d0 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:41.188035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e26a14fc-aab0-48d9-87a1-00b61f712440 tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/1f016eb3-fb1f-4266-8966-520101be59d0" status: 404 len: 109 microversion: 2.1 time: 0.142934 Jun 17 07:19:41.188844 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 7/8] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:19:41 2022] DELETE /compute/v2.1/os-volumes/1f016eb3-fb1f-4266-8966-520101be59d0 => generated 109 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:19:41.196609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2fdc2ded-0091-44b0-9b08-a7252c36463b tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Calling method '.version_select at 0x7f8b6f37f670>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:41.250362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4e7d0bee-da99-4c70-89e4-379cecb35180 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 200 len: 353 microversion: 2.1 time: 0.096366 Jun 17 07:19:41.251213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 2/9] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:41 2022] GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:19:41.276808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-2fdc2ded-0091-44b0-9b08-a7252c36463b tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] HTTP exception thrown: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2fdc2ded-0091-44b0-9b08-a7252c36463b tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Request method failure captured: Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/os-volumes/7ecd5972-50fa-4447-9945-00b57d70a966 HTTP/1.1 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsK0Ane3qZxmG_VGpp_LJZSLs9jNr3rwhxXgDky6T7ES7Unjo1pWE3v0FuLoKAmtP4e7lT4uNQa7rGSWa85i6xkvrwNUGnVM3fTYw-P_Xhd8jFXa6rvEcKn4LW-_03kUytd-bER1XOcIDNqHYYT-k94WvH8KC9ZStsBCV_1ez4Mq6Y Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:19:41.279835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7bdb0b874c434af39fb644908137de77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7bdb0b874c434af39fb644908137de77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7bdb0b874c434af39fb644908137de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 7bdb0b874c434af39fb644908137de77 Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-779098166 Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: ad2d4ce6c4b840b78abc19c28063a747 Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-779098166-project Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '7ecd5972-50fa-4447-9945-00b57d70a966'} Jun 17 07:19:41.281319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. (HTTP 404) (Request-ID: req-70d16464-fc8c-4ca8-b00f-1a7fa0fea090) Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.282383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:19:41.283731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:19:41.285146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2fdc2ded-0091-44b0-9b08-a7252c36463b tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] Returning 404 to user: Volume 7ecd5972-50fa-4447-9945-00b57d70a966 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2fdc2ded-0091-44b0-9b08-a7252c36463b tempest-VolumesNegativeTest-779098166 tempest-VolumesNegativeTest-779098166-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7ecd5972-50fa-4447-9945-00b57d70a966" status: 404 len: 109 microversion: 2.1 time: 0.091558 Jun 17 07:19:41.286753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 8/10] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:41 2022] GET /compute/v2.1/os-volumes/7ecd5972-50fa-4447-9945-00b57d70a966 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:19:42.262933 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a956f592-959d-4984-807e-4c4be5dc5194 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f3ee940>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:42.401134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a956f592-959d-4984-807e-4c4be5dc5194 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 200 len: 354 microversion: 2.1 time: 0.133976 Jun 17 07:19:42.401134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 3/11] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:42 2022] GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:19:42.426639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a32599e1-a00a-48e0-b42a-d9e1162c5a8f tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f37f9d0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:42.536972 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a32599e1-a00a-48e0-b42a-d9e1162c5a8f tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 200 len: 354 microversion: 2.1 time: 0.131215 Jun 17 07:19:42.538261 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 9/12] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:42 2022] GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 354 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:19:42.555754 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c0496536-5457-4ef7-88fa-8bf9225e7773 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f3eed30>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:42.701213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c0496536-5457-4ef7-88fa-8bf9225e7773 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 202 len: 0 microversion: 2.1 time: 0.150665 Jun 17 07:19:42.704810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 4/13] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:19:42 2022] DELETE /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:19:42.712425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8060590d-daab-486e-b48b-36dad2bf4e47 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f390280>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:42.831166 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8060590d-daab-486e-b48b-36dad2bf4e47 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 200 len: 353 microversion: 2.1 time: 0.124822 Jun 17 07:19:42.831914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 10/14] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:42 2022] GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:19:43.845015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8dbd26bf-83b7-48f5-9d63-300ade0d4a88 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Calling method '.version_select at 0x7f8b6f405430>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:43.891381 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-8dbd26bf-83b7-48f5-9d63-300ade0d4a88 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] HTTP exception thrown: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8dbd26bf-83b7-48f5-9d63-300ade0d4a88 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Request method failure captured: Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 HTTP/1.1 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsJUvKwF7Yg9XqO0QfQqqSdnqwgZ48pC-8e7JrwKI_HYTrgDa5gZTIyUlX5fi6pikhJWaCgpylXpwmae-AJupcX6DJ6KZV29VSXJWuXor23C4tymeKCvIcA15Kbh5_mtBUFox7vEyK0j6wZKEC6R7TUZ2NJkinEVPlWjjPYht6SV4Q Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: ca5bba369109460b8a44d927072bd277 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-VolumesGetTestJSON-1471434973 Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:19:43.895845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca5bba369109460b8a44d927072bd277"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca5bba369109460b8a44d927072bd277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca5bba369109460b8a44d927072bd277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca5bba369109460b8a44d927072bd277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-VolumesGetTestJSON-1471434973 Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: ca5bba369109460b8a44d927072bd277 Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-VolumesGetTestJSON-1471434973 Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-VolumesGetTestJSON-1471434973-project Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 3d519a07e8434aaa95adb641b669838f Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-VolumesGetTestJSON-1471434973-project Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1'} Jun 17 07:19:43.896971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. (HTTP 404) (Request-ID: req-6748fa13-cc1d-4982-b48c-740179141dc3) Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:43.897703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:19:43.898526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:19:43.899506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. Jun 17 07:19:43.901062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:19:43.902615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8dbd26bf-83b7-48f5-9d63-300ade0d4a88 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] Returning 404 to user: Volume 3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:19:43.904683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8dbd26bf-83b7-48f5-9d63-300ade0d4a88 tempest-VolumesGetTestJSON-1471434973 tempest-VolumesGetTestJSON-1471434973-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1" status: 404 len: 109 microversion: 2.1 time: 0.063012 Jun 17 07:19:43.905518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 5/15] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:19:43 2022] GET /compute/v2.1/os-volumes/3f4dc999-aa12-4e2c-a6fc-7c2b38798bf1 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:19:44.636538 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f3df28ae-a007-4c4e-a552-bf99b1f11979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: .version_select at 0x7f8b6f390b80>, body: {"keypair": {"name": "tempest-keypair-2124569093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtAAhKJUMMatB+gSpo8NyndwHQX6OY0z+27+DS7OgKXvfuRLzO97gQADH+zj8vhnoBJUXgUFw5SjJhB/cLaciqFEFFsyHG/sOK3o21D5I5QvuGgZrKxQeDzjjUubOTJ/Q=="}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:44.731756 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-f3df28ae-a007-4c4e-a552-bf99b1f11979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for project ab7deafed6f447faade3e3d8d281617a. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:19:44.749675 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-f3df28ae-a007-4c4e-a552-bf99b1f11979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for user b3ca63f8f8484ddf9d7c72749ba7f482 and project ab7deafed6f447faade3e3d8d281617a. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:19:44.878565 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f3df28ae-a007-4c4e-a552-bf99b1f11979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.729874 Jun 17 07:19:44.879530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 11/16] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:19:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:19:52.072689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1390427886", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1239213d-0a3b-407c-aa59-5c1ac224edf4"}], "security_groups": [{"name": "tempest-securitygroup--471658916"}], "key_name": "tempest-keypair-2124569093", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:52.606913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] validate_networks() for [('1239213d-0a3b-407c-aa59-5c1ac224edf4', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:19:54.502054 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:19:54.503077 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:19:54.504295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:19:54.504960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:19:54.505585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:19:54.541225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:54.552676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:54.558273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:54.559073 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:54.656109 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for project ab7deafed6f447faade3e3d8d281617a. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:19:54.667293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for user b3ca63f8f8484ddf9d7c72749ba7f482 and project ab7deafed6f447faade3e3d8d281617a. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:19:54.701206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:19:54.704581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:19:54.853842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-36d39301-4474-45f3-a06a-ff3489dae1e3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.801137 Jun 17 07:19:54.854507 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 6/17] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:19:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:19:54.865101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-64489f9e-10f0-4891-924c-8381dbb51ea0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:54.867014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-64489f9e-10f0-4891-924c-8381dbb51ea0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:19:54.929045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=4 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:54.929801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:55.166993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-64489f9e-10f0-4891-924c-8381dbb51ea0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:19:55.214522 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-64489f9e-10f0-4891-924c-8381dbb51ea0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1238 microversion: 2.1 time: 0.353333 Jun 17 07:19:55.215441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 12/18] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:19:54 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1238 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:19:56.235621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8a7a2e29-8cd8-44eb-a682-8b7c3af0599a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:56.236599 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8a7a2e29-8cd8-44eb-a682-8b7c3af0599a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:19:56.506250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8a7a2e29-8cd8-44eb-a682-8b7c3af0599a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:19:56.515446 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8a7a2e29-8cd8-44eb-a682-8b7c3af0599a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1238 microversion: 2.1 time: 0.288085 Jun 17 07:19:56.531601 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 13/19] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:19:56 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1238 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:19:56.816366 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a7f55e71-26d5-48ac-a30e-3cf6f64992f1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: .version_select at 0x7f8b6ea70af0>, body: {"keypair": {"name": "tempest-keypair-1372414217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB76YFQM/1C95G8Lvx8B2bdxxF3OCyM8ojd06AJG5tKyNisvRfv7AAvzpqiqEQS31rTL0e7qK6aG0WERv3tKg0XI41NH9CHCXjSpcvsI4SG11MIUMPWSgGsvwplDSt52jQ=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:56.865618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a7f55e71-26d5-48ac-a30e-3cf6f64992f1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for project 277f81ef9ed74a6189221440edd53d4c. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:19:56.870860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a7f55e71-26d5-48ac-a30e-3cf6f64992f1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for user 31e94cc1c6a743ce898424ad7ba26cf1 and project 277f81ef9ed74a6189221440edd53d4c. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:19:56.971543 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a7f55e71-26d5-48ac-a30e-3cf6f64992f1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.814983 Jun 17 07:19:56.979847 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 7/20] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Jun 17 07:19:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 824 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 07:19:57.545718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:57.546864 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:19:57.625202 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:57.625925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:57.626869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:57.629971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:57.717440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1769534003", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:57.956153 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] validate_networks() for [('60349c8e-a9e4-4c17-896b-25e895292e2e', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:19:58.135962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:19:58.180421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-29537859-4918-427b-b08c-ba9fb76d60b8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1242 microversion: 2.1 time: 0.638572 Jun 17 07:19:58.193132 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 8/21] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:19:57 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1242 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:19:58.787654 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-571542132", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "networks": [{"uuid": "57d55a23-c630-40ec-bb39-da47a22efdb9"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:19:58.870250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] validate_networks() for [('57d55a23-c630-40ec-bb39-da47a22efdb9', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:19:59.437211 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:19:59.438201 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:19:59.439027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:19:59.439661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:19:59.440408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:19:59.459951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:59.461331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:59.463229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:59.463692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:59.524883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:19:59.546621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for user c11f44eb67cd4923a840171833bb572a and project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:19:59.609106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:19:59.622395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:19:59.746437 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a99b0902-93c5-4ae3-806d-e34685bba0f5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.722622 Jun 17 07:19:59.748458 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 14/22] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:19:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:19:59.762806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:19:59.763450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:19:59.804518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:59.807005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:19:59.808162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:19:59.811057 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:00.192024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:00.206960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-12498f9f-12bc-4db3-9f56-96977f26b76b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1290 microversion: 2.1 time: 0.453773 Jun 17 07:20:00.207952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 15/23] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:19:59 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1290 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:00.231275 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3ae9ba99-9c55-4017-888d-8cb9737564b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:00.232589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3ae9ba99-9c55-4017-888d-8cb9737564b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:00.519089 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3ae9ba99-9c55-4017-888d-8cb9737564b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:00.528216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3ae9ba99-9c55-4017-888d-8cb9737564b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1222 microversion: 2.1 time: 0.318684 Jun 17 07:20:00.534895 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 16/24] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:00 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1222 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:00.802168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-842606657", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:00.963630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:20:00.964198 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:20:00.964607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:20:00.965764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:20:00.966288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:20:00.978431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] validate_networks() for [('60349c8e-a9e4-4c17-896b-25e895292e2e', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:20:00.997473 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:01.000864 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:01.001942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:01.002491 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:01.084495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Getting quotas for project 09dfc5c0d3f4405a901acd8eeef080b9. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:20:01.090353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Getting quotas for user 6d04750a83fb465e8fba24c1143d4eff and project 09dfc5c0d3f4405a901acd8eeef080b9. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:20:01.116084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:20:01.121143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:20:01.225839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-67b262f4-8ff9-4db9-bc0b-d7538e6fd3cf tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.959494 Jun 17 07:20:01.226724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 9/25] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:19:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:20:01.243007 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:01.248548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:01.259233 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:01.265253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:01.266394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:01.267229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:01.504619 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:01.516779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9370039b-df2f-4d57-8877-4785c0ab116e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1296 microversion: 2.1 time: 0.278389 Jun 17 07:20:01.524126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 10/26] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:01 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1296 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:01.531474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-828b5642-115a-498e-a488-2ca09cf7c93d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:01.532351 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-828b5642-115a-498e-a488-2ca09cf7c93d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:01.697723 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-828b5642-115a-498e-a488-2ca09cf7c93d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:01.744753 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-828b5642-115a-498e-a488-2ca09cf7c93d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1214 microversion: 2.1 time: 0.219087 Jun 17 07:20:01.749725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 11/27] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:01 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:01.776175 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1155467950", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed70ad4c-5186-4d7f-a1ab-3e0db877b874"}], "security_groups": [{"name": "tempest-securitygroup--1741175617"}], "key_name": "tempest-keypair-1372414217", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:02.046475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] validate_networks() for [('ed70ad4c-5186-4d7f-a1ab-3e0db877b874', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:20:02.981626 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:20:02.982247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:20:02.982518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:20:02.983322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:20:02.983901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:20:03.024282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.025158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.026235 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.026840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.068362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:20:03.080162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for user c11f44eb67cd4923a840171833bb572a and project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:20:03.109415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:20:03.113030 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:20:03.191382 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c008aabf-1fb1-486c-831a-8fdb898515b6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.394243 Jun 17 07:20:03.197729 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 17/28] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:20:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:20:03.203218 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:03.204013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:03.214545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.215251 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.216725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.217327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.220762 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:20:03.221308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:20:03.222029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:20:03.222548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:20:03.223095 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:20:03.258964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.262951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.269981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.273052 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.344969 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for project 277f81ef9ed74a6189221440edd53d4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:20:03.355370 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for user 31e94cc1c6a743ce898424ad7ba26cf1 and project 277f81ef9ed74a6189221440edd53d4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:20:03.381768 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:20:03.387649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:20:03.467186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-140ecbe7-c931-4453-a286-f67f9bb90749 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.712733 Jun 17 07:20:03.474406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 12/29] 10.222.0.33 () {62 vars in 1187 bytes} [Fri Jun 17 07:20:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 07:20:03.481697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:03.482586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:03.493220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.494066 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.495340 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:03.496044 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:03.648187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:03.660519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8506d1fd-1d0f-496c-b9bf-30dbc92c653d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1218 microversion: 2.1 time: 0.184152 Jun 17 07:20:03.667724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 13/30] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:03 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:03.672518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cde4d5d9-dc69-4aa6-8536-9964a4a97a17 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:03.673125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cde4d5d9-dc69-4aa6-8536-9964a4a97a17 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:03.898314 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cde4d5d9-dc69-4aa6-8536-9964a4a97a17 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:03.913108 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cde4d5d9-dc69-4aa6-8536-9964a4a97a17 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1221 microversion: 2.1 time: 0.241223 Jun 17 07:20:03.915793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 14/31] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:03 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:03.930299 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:03.931683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:04.063635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:04.098687 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:04.104255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a52d767d-ce55-4c4a-ba64-5d718b1866d5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.886649 Jun 17 07:20:04.106024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 18/32] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:03 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:04.113773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:04.122623 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:04.145546 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-26219bae-3de9-43ae-8ce3-9f916876dd67 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1282 microversion: 2.20 time: 0.228088 Jun 17 07:20:04.155574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 15/33] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:03 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:04.688548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:04.689950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:04.710832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:04.716889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:04.725035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:04.726425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:04.939464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:04.940428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:04.976194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:04.993212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:04.994538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:04.994994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:05.246127 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:05.262577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b7b484f9-430c-441e-8ad1-0ec51e09398e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1217 microversion: 2.1 time: 0.335579 Jun 17 07:20:05.278322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 16/34] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:04 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1217 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:05.290788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:05.298994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:05.314686 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:05.318876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:05.320966 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:05.322568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:05.361371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:05.377088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a07a6ec4-df37-43e4-9de2-d6117a9910bc tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1218 microversion: 2.1 time: 0.696444 Jun 17 07:20:05.392118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 19/35] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:04 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1218 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:05.406874 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:05.408739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:05.428579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:05.433187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:05.435329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:05.436050 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:05.754198 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:05.770170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4a67dcc4-7039-4014-a83c-af072b990976 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.489112 Jun 17 07:20:05.770972 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 17/36] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:05 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:06.148374 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:06.197274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:06.217349 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:06.224336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1ceff2d7-40e6-4985-bd85-3b737aa0b5ec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1334 microversion: 2.20 time: 0.825065 Jun 17 07:20:06.228966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 20/37] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:05 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1334 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:06.287267 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:06.288843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:06.309078 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.311595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:06.316535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.319187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:06.399169 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:06.400652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:06.419680 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.426710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:06.427599 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.432187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:06.715313 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:06.730208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8898940a-cd5a-4ee8-b53a-1def0419033c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1273 microversion: 2.1 time: 0.448065 Jun 17 07:20:06.735596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 18/38] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:06 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:06.792502 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:06.793568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:06.810141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.811979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:06.816288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:06.816927 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:07.082620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:07.102509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5e2f2911-d4d8-46d7-a97e-3ef565216267 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1266 microversion: 2.1 time: 0.705320 Jun 17 07:20:07.103643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:06 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1266 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:07.247106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:07.248513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:07.264158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:07.267634 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:07.269779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:07.271911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:07.571666 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:07.584162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:07.587671 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:07.598527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:07.599733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-30559fa4-f495-4ba4-841e-f6c7002fccc2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1334 microversion: 2.20 time: 0.357677 Jun 17 07:20:07.600414 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 22/40] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:07 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1334 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:07.625010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-33047c35-12e0-4a4d-8691-46b25c7bee2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.829444 Jun 17 07:20:07.645461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 19/41] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:06 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:07.757651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:07.758590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:07.790716 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:07.796959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:07.798245 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:07.807905 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.122121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:08.122981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:08.140009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.142357 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.146797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.147331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.263947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:08.272121 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d3507a57-69d0-4bdb-8ea7-8c74d93fd8a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1281 microversion: 2.1 time: 0.522879 Jun 17 07:20:08.274541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 23/42] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:07 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1281 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:08.444771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:08.457260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-26099965-ae4c-435b-adb2-8919aeeacc79 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1274 microversion: 2.1 time: 0.339891 Jun 17 07:20:08.460041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 20/43] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:08 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1274 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:08.623379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:08.623997 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:08.631198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.636109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.637185 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.640879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.659603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:08.660268 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:08.670125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.670573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.677308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:08.686956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:08.927020 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:08.941770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:08.951454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:08.953098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c25513e7-8069-4b86-8f66-8f153c9379f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1342 microversion: 2.20 time: 0.338096 Jun 17 07:20:08.955568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 24/44] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:08 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1342 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:08.992317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:09.003954 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7e9e4059-9206-4aaa-ab8c-18034cdba291 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.348840 Jun 17 07:20:09.004593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 21/45] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:08 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:09.302397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:09.303412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:09.324323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.329940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.330079 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.336567 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.480550 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:09.481170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:09.492669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.493691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.496548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.496997 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.587995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:09.598364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-69288e0b-f8bd-43fb-837c-d42753662246 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1291 microversion: 2.1 time: 0.301463 Jun 17 07:20:09.598951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 25/46] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:09 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1291 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:09.815510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:09.849435 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9c3268e9-d808-4e2f-aff5-46dacbe61f2f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1274 microversion: 2.1 time: 0.373116 Jun 17 07:20:09.853548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 22/47] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:09 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1274 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:09.938127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-4405d616-6aac-4257-9627-7a63d7ed81e5 req-518bbdfe-0116-44cd-8df0-2b823593ab38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a8c90c-c561-4193-8276-ae0351b550f4", "tag": "b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:09.959098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4405d616-6aac-4257-9627-7a63d7ed81e5 req-518bbdfe-0116-44cd-8df0-2b823593ab38 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.960198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4405d616-6aac-4257-9627-7a63d7ed81e5 req-518bbdfe-0116-44cd-8df0-2b823593ab38 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.978552 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:09.979628 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:09.987921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.988674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:09.990120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:09.991071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.006496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-4405d616-6aac-4257-9627-7a63d7ed81e5 req-518bbdfe-0116-44cd-8df0-2b823593ab38 service nova] Creating event network-changed:b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c for instance 73a8c90c-c561-4193-8276-ae0351b550f4 on hv-cinder-83482 Jun 17 07:20:10.007053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4405d616-6aac-4257-9627-7a63d7ed81e5 req-518bbdfe-0116-44cd-8df0-2b823593ab38 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117396) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 07:20:10.009718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.010193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.010996 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.011482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.024124 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.compute.rpcapi [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 07:20:10.025135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] Releasing lock "compute-rpcapi-router" {{(pid=117396) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 07:20:10.057803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5cf3d4ac-24ed-4198-b0c7-b01c756a336c None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325182 Jun 17 07:20:10.058927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 26/48] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:10.066537 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:10.068703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:10.084491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.086135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.088014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.089998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.103447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.111941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.121645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.122943 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7994165c-8b51-4fd4-a256-89f6ae553403 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1342 microversion: 2.20 time: 0.152640 Jun 17 07:20:10.124300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 23/49] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:09 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:20:10.321382 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.331026 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-60b26259-7633-433e-8ba0-fb7c1ced6979 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.270530 Jun 17 07:20:10.333521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 27/50] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:10 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:10.617226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:10.617974 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:10.621258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:10.630538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.631219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.631998 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.632461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.825736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.854824 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ab24c3ac-0d22-4920-93bc-86347a124cb2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1291 microversion: 2.1 time: 0.235650 Jun 17 07:20:10.861039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 24/51] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:10 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1291 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:10.875932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:10.876992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:10.884924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.887636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.890284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:10.891496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:10.982846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:10.997901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ff56cdd0-c8d2-4511-b4d9-aa928bb71f99 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1274 microversion: 2.1 time: 0.131569 Jun 17 07:20:11.008500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 28/52] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:10 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:11.144349 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:11.145082 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:11.158718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.159495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:11.160496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.161616 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:11.254118 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:11.269706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:11.272528 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:11.274079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-472a84d4-287c-4089-8c6e-38cc957a0907 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1342 microversion: 2.20 time: 0.136924 Jun 17 07:20:11.275894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 25/53] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:11 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:11.352359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:11.353241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:11.376463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.376921 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:11.377735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.378138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:11.605174 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:11.627426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-008ea92d-aced-401e-ade3-1dd3a268c684 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.281007 Jun 17 07:20:11.637235 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 29/54] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:11 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:11.879097 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:11.879728 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:11.891818 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.892485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:11.893428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:11.894014 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.015798 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:12.016542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:12.036933 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.037573 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.038422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.045797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.061099 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:12.073766 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-18ad2c75-c776-4652-9bb5-8b93d4220108 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1291 microversion: 2.1 time: 0.199617 Jun 17 07:20:12.081107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 26/55] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:11 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1291 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:12.262832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:12.272885 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b431817a-744f-49c8-94d2-2096efb0375a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1274 microversion: 2.1 time: 0.261151 Jun 17 07:20:12.283707 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 30/56] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:12 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:12.294174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:12.295053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:12.310989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.311624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.320691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.321414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.405073 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:12.420860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:12.423874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:12.426516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-195713a5-7cb1-40fc-99e3-296549d00aef tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1342 microversion: 2.20 time: 0.136661 Jun 17 07:20:12.427631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 27/57] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:12 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:12.656347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:12.657310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:12.666641 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.667440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:12.669101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:12.670394 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.006961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:13.023309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9cff0a75-dca6-4b87-88d4-99bca002fc50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.373471 Jun 17 07:20:13.034976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 31/58] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:12 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:13.100969 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:13.103374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:13.116608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.116608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.119902 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.122831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.253665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:13.293555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:13.294186 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:13.297566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=18 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:13.309071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:13.325063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.326238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.330263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.330951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.538159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:13.550799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-70abd055-2c42-4302-b4e2-0b5990a2e907 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1291 microversion: 2.1 time: 0.454653 Jun 17 07:20:13.551377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 28/59] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:13 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1291 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:13.588681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:13.589302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:13.637980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.637980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:13.638712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:13.645754 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:14.001224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:14.018145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cc6f7628-8e81-4b1d-a297-4f99bd55b1f8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1284 microversion: 2.1 time: 0.730825 Jun 17 07:20:14.020115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 32/60] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:13 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1284 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:14.042411 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:14.044149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:14.061512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:14.062000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:14.062841 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:14.063264 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:14.075202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:14.110602 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=28 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:14.316934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:14.343285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:14.356744 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:14.359944 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8bddc8ea-acca-4974-b218-a9ddfbe2eaec tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1342 microversion: 2.20 time: 0.806122 Jun 17 07:20:14.364344 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 29/61] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:13 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1342 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:14.573532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:14.574389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:14.590747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:14.592261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:14.594613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:14.596399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:14.745256 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:14.755567 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f5a822c7-cef0-49d6-9682-eeef83dd467c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.717689 Jun 17 07:20:14.760362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 33/62] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:14 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:15.038586 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:15.039693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:15.052964 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.053774 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:15.067236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.067882 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:15.100450 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:15.139160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2fc8fe34-7786-4736-9df1-bd11de6e6d26 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1279 microversion: 2.1 time: 0.573262 Jun 17 07:20:15.144110 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 30/63] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:14 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1279 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:15.397911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:15.398151 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:15.399378 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:15.417615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.418040 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-070ffa65-3998-4a05-8d72-856eca823b71 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1272 microversion: 2.1 time: 0.376364 Jun 17 07:20:15.428196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 34/64] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:15 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1272 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:15.435327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:15.445026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.446749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:15.592733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:15.601876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:15.610413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:15.611784 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2adaaea0-9a70-48bb-a97a-0699f1de0327 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1340 microversion: 2.20 time: 0.236139 Jun 17 07:20:15.612607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 31/65] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:15 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1340 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:15.776517 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:15.778177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:15.792579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.794725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:15.796529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:15.800153 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:16.159646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:16.161535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:16.173585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:16.175772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:16.176888 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:16.177704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:16.874311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:16.885245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ec6b24f3-3df8-4206-a121-9bdcddbb81b7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1279 microversion: 2.1 time: 0.729926 Jun 17 07:20:16.890645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 32/66] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:16 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1279 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:16.898122 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:16.900305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:16.918337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:16.922141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:16.923329 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:16.923996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:16.996326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:17.005870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d403600c-729a-4f1a-8e8d-7a01c5ff1524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 1.233750 Jun 17 07:20:17.010196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 35/67] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:15 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:17.026362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:17.026362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:17.041993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:17.044981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:17.046741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:17.049040 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:17.369674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:17.380123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c63e3fcb-3414-4eda-b5e7-2a51208d080a tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.485570 Jun 17 07:20:17.380346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 33/68] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:16 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:17.591158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:17.605597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:17.609642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:17.611157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-267a5c72-bf9f-4ec6-9226-19efa8de6d95 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.598476 Jun 17 07:20:17.624633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 36/69] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:17 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:17.908182 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:17.909213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:17.927208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:17.927859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:17.931918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:17.934449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:18.029241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:18.029902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:18.044392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:18.052249 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:18.056370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:18.057132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:18.802545 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:18.815842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-28d5d296-47e8-4689-a32d-bdf48db9c810 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.912237 Jun 17 07:20:18.827320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 34/70] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:17 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:18.832646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:18.833379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:18.841626 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:18.842136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:18.842917 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:18.843351 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.047300 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:19.059324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e9e8dce2-4780-4569-8f04-8414212eeba6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 1.035589 Jun 17 07:20:19.070572 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:19.070743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 37/71] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:18 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:19.077141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:19.077769 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:19.085380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-14cd3672-e3e0-4979-adc7-d5f436798895 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.255236 Jun 17 07:20:19.085901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.087017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 35/72] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:18 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:19.096231 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.097517 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.098109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.341742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-d6bd2202-0562-402d-8c41-9326b0e62677 req-cc814985-0c84-4664-be2a-9288ad3136be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5420c538-ebd6-4349-934d-9cd2d5ec2cfc", "tag": "679e8420-15a8-4888-a16d-37cc6488380e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:19.355913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-d6bd2202-0562-402d-8c41-9326b0e62677 req-cc814985-0c84-4664-be2a-9288ad3136be service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.356404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-d6bd2202-0562-402d-8c41-9326b0e62677 req-cc814985-0c84-4664-be2a-9288ad3136be service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.379914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-d6bd2202-0562-402d-8c41-9326b0e62677 req-cc814985-0c84-4664-be2a-9288ad3136be service nova] Creating event network-changed:679e8420-15a8-4888-a16d-37cc6488380e for instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc on hv-cinder-83482 Jun 17 07:20:19.381024 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-d6bd2202-0562-402d-8c41-9326b0e62677 req-cc814985-0c84-4664-be2a-9288ad3136be service nova] Acquired lock "compute-rpcapi-router" {{(pid=117395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 07:20:19.382569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.383250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.385064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.386099 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.396561 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.compute.rpcapi [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 07:20:19.397701 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] Releasing lock "compute-rpcapi-router" {{(pid=117395) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 07:20:19.438642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-14543368-8ad6-4bb0-8bb6-fdf6fbd8f307 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349672 Jun 17 07:20:19.440386 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 36/73] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:19.449764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-3acca8c3-b791-499b-adf1-9c3e7b4d68e2 req-b8e77762-9fd2-4895-9d9b-3b74fd048846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd2b266-655e-4605-8db4-c708addf8e80", "tag": "2b54f26a-5895-4258-b7f5-aa5845feef41"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:19.460456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-3acca8c3-b791-499b-adf1-9c3e7b4d68e2 req-b8e77762-9fd2-4895-9d9b-3b74fd048846 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.461186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-3acca8c3-b791-499b-adf1-9c3e7b4d68e2 req-b8e77762-9fd2-4895-9d9b-3b74fd048846 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.474567 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-3acca8c3-b791-499b-adf1-9c3e7b4d68e2 req-b8e77762-9fd2-4895-9d9b-3b74fd048846 service nova] Creating event network-changed:2b54f26a-5895-4258-b7f5-aa5845feef41 for instance bbd2b266-655e-4605-8db4-c708addf8e80 on hv-cinder-83482 Jun 17 07:20:19.485846 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-3acca8c3-b791-499b-adf1-9c3e7b4d68e2 req-b8e77762-9fd2-4895-9d9b-3b74fd048846 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041689 Jun 17 07:20:19.489039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 37/74] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:19.574441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:19.584898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:19.586450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:19.587606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1d7e66d2-657d-48e5-b5e8-d9eb64fcc744 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.515702 Jun 17 07:20:19.604111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 38/75] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:19 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:19.833102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:19.834527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:19.843177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.843901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:19.848537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:19.849303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.115597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:20.116471 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:20.129297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:20.134012 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.135530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.137982 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.139212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.230159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.246924 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6841f2ea-a146-4b2b-8ed6-51a24b13aacf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.418159 Jun 17 07:20:20.250737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 38/76] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:19 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:20.258244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:20.259357 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:20.272900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.273620 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.274826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.280399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.528291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.537299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a0d12ce9-8002-44ff-9eb1-6eaf171f5efe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.464087 Jun 17 07:20:20.538727 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 39/77] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:20 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:20.545130 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.553218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-763075b3-4c1f-4607-b1fc-ce1fd3dac9ba tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.301428 Jun 17 07:20:20.554360 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 39/78] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:20 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:20.614423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:20.615255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:20.622229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.622753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.623697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:20.624175 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:20.792232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.801105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.802614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:20.803726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e1e98549-06a6-4230-9f71-a1b82897801a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.193239 Jun 17 07:20:20.814135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 40/79] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:20 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:21.270644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:21.271248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:21.278399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:21.279113 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:21.280238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:21.280909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:21.475782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-9c47e641-f781-4727-89f0-d3e753446907 req-f3543c9f-8249-4222-95d6-70146472fca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d88b5d-9a22-4092-a847-ca3fdb686228", "tag": "b91810a2-f141-4e45-96ab-9963b0a82c19"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:21.486451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9c47e641-f781-4727-89f0-d3e753446907 req-f3543c9f-8249-4222-95d6-70146472fca2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:21.487289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9c47e641-f781-4727-89f0-d3e753446907 req-f3543c9f-8249-4222-95d6-70146472fca2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:21.503328 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-9c47e641-f781-4727-89f0-d3e753446907 req-f3543c9f-8249-4222-95d6-70146472fca2 service nova] Creating event network-changed:b91810a2-f141-4e45-96ab-9963b0a82c19 for instance 12d88b5d-9a22-4092-a847-ca3fdb686228 on hv-cinder-83482 Jun 17 07:20:21.510488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-9c47e641-f781-4727-89f0-d3e753446907 req-f3543c9f-8249-4222-95d6-70146472fca2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038678 Jun 17 07:20:21.511749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 41/80] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:21.555942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:21.556979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:21.573439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:21.574099 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:21.575745 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:21.579947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.152112 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.168477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0c1f3b2e-3be8-472e-adda-141a66d186a4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.617512 Jun 17 07:20:22.169114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 42/81] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:21 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:22.184906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:22.185523 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:22.203649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:22.204309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.205240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:22.205865 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.253060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.266467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-10293713-8932-4d6a-afdf-e29fa5b06ee5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.999549 Jun 17 07:20:22.270459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 40/82] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:21 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:22.287218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a47ed76e-bc87-4739-8dca-314188498d62 req-e25441e3-c7d6-4b15-8490-f040de85b08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:22.324616 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a47ed76e-bc87-4739-8dca-314188498d62 req-e25441e3-c7d6-4b15-8490-f040de85b08b service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:22.326826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a47ed76e-bc87-4739-8dca-314188498d62 req-e25441e3-c7d6-4b15-8490-f040de85b08b service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.363851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a47ed76e-bc87-4739-8dca-314188498d62 req-e25441e3-c7d6-4b15-8490-f040de85b08b service nova] Creating event network-changed:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:20:22.372614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a47ed76e-bc87-4739-8dca-314188498d62 req-e25441e3-c7d6-4b15-8490-f040de85b08b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096416 Jun 17 07:20:22.385650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 41/83] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:22.385650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:22.396736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:22.411002 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:22.411205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.412747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:22.413262 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:22.823744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.833554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fcca66aa-35f6-4c2d-b9eb-3129dfef5834 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.653286 Jun 17 07:20:22.834581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 43/84] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:22 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:22.870824 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.880355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.888882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:22.891322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-48596d9c-1bd1-468f-b7f9-4dc178882cc1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.514525 Jun 17 07:20:22.892121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 42/85] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:22 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:23.188044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:23.188676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:23.192085 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:23.201849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.202297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.203077 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.203519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.289785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:23.290456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:23.306104 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.307425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.308252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.308968 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.441655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:23.450355 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e1fcbda7-5148-4253-bd31-f84371029c64 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.266887 Jun 17 07:20:23.452998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 44/86] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:23 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:23.477825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:23.486206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-291a0366-be53-4bed-a968-2b9e246b2538 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.203074 Jun 17 07:20:23.495442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 43/87] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:23 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:23.853155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:23.853770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:23.861955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.863139 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.864254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.864872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.910424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:23.911035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:23.933577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.934042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:23.935010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:23.945520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:24.197260 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.206443 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b41f3d3c-2889-4bb2-b89d-3291556eb615 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.358624 Jun 17 07:20:24.218443 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 45/88] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:23 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:24.235694 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.250339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.252530 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.254137 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fd38c5c8-4844-4cd7-9114-bb9839dd2d00 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.348203 Jun 17 07:20:24.255252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 44/89] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:23 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:24.471312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:24.472154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:24.481656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:24.482113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:24.482884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:24.483318 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:24.503324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:24.504505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:24.514664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:24.516899 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:24.520976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:24.522007 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:24.667985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.677111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b0986979-f196-4720-af7d-7c692ac158fc tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.210770 Jun 17 07:20:24.678269 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 46/90] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:24 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:24.746362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:24.758853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3715e3bd-914e-4b49-84b8-8e8890a82d51 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.259474 Jun 17 07:20:24.771043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 45/91] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:24 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:25.224543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:25.225820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:25.233055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.233944 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.234913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.235679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.276542 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:25.276919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:25.293008 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.293468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.296937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.297446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.455407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:25.464580 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2388b1f2-5e3a-48d3-98e0-b0f2c64fa05d tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.244270 Jun 17 07:20:25.467304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 47/92] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:25 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:25.697494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:25.699816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:25.710541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.711001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.711819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.712290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.924712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:25.931825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:25.935310 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:25.948778 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:25.951801 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6f5b134c-43f9-46d0-9980-a886c7b51ade tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.682382 Jun 17 07:20:25.952897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 46/93] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:25 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:25.959170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:25.959983 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:25.966978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.967426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:25.968217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:25.969302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:26.153483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:26.162289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-54c9590c-b441-4949-8275-0d58ae78bd6e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.207680 Jun 17 07:20:26.162926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 47/94] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:25 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:26.172970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:26.173716 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e64f2281-6402-432c-98f4-fce8eb08e21c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.482728 Jun 17 07:20:26.174307 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 48/95] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:25 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:26.486338 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:26.487689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:26.507206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:26.507979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:26.509042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:26.514544 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:26.970113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:26.971290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:26.977921 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:26.978369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:26.979343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:26.979979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:27.069430 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.084660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-53985282-7d0e-410c-bd9e-7c2f69fca977 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.601337 Jun 17 07:20:27.098778 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 48/96] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:26 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:27.153642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.169452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.184476 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:27.185143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:27.190505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.191970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-03018feb-0712-41ae-ab6d-666d91325005 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.225845 Jun 17 07:20:27.200045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 49/97] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:26 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:20:27.207019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:27.207595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:27.208764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:27.209579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:27.221627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:27.224188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:27.233814 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:27.234506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:27.235660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:27.236825 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:27.268389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:27.458740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.468038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6e56b407-027f-4f25-8900-602d10c4c7a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.292046 Jun 17 07:20:27.469300 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:27.469726 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 49/98] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:27 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:27.485358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e7d7c56c-4ac4-440f-a3a0-741b929c3d2d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.283783 Jun 17 07:20:27.487836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 50/99] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:27 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:28.110894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:28.110894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:28.122029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.122554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.123347 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.123794 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.211455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:28.212154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:28.219412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.220262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.222216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.223052 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.466156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:28.474961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:28.477648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:28.479026 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7962a829-927f-4a10-bb4f-3a4ca000c54b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.271712 Jun 17 07:20:28.479630 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 51/100] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:28 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:20:28.584086 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:28.595210 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3e06e044-a4bd-45a6-97a0-c284e7437277 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.497079 Jun 17 07:20:28.604657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 50/101] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:28 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:28.609984 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:28.610578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:28.618796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.619520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.620494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.621075 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.678005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-883f6289-9132-47ca-a696-ba5ef19afa5f req-1544f2af-b2e1-41b7-89d2-087ab5161f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5420c538-ebd6-4349-934d-9cd2d5ec2cfc", "name": "network-vif-plugged", "status": "completed", "tag": "679e8420-15a8-4888-a16d-37cc6488380e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:28.688154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-883f6289-9132-47ca-a696-ba5ef19afa5f req-1544f2af-b2e1-41b7-89d2-087ab5161f35 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.688873 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-883f6289-9132-47ca-a696-ba5ef19afa5f req-1544f2af-b2e1-41b7-89d2-087ab5161f35 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.701607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-883f6289-9132-47ca-a696-ba5ef19afa5f req-1544f2af-b2e1-41b7-89d2-087ab5161f35 service nova] Creating event network-vif-plugged:679e8420-15a8-4888-a16d-37cc6488380e for instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc on hv-cinder-83482 Jun 17 07:20:28.707757 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-883f6289-9132-47ca-a696-ba5ef19afa5f req-1544f2af-b2e1-41b7-89d2-087ab5161f35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226624 Jun 17 07:20:28.713140 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 52/102] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:28.729936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:28.731029 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:28.746066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.746689 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.747658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:28.748271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:28.845218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:28.859801 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-29ed93c7-42cd-4508-98a0-a0f54a7d4097 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.253464 Jun 17 07:20:28.862967 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 51/103] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:28 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:29.026927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:29.037809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c9551424-6515-4706-bba3-f769d06b3446 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.323061 Jun 17 07:20:29.054141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 53/104] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:28 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:29.501581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:29.503648 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:29.512418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:29.518724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.519693 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:29.521712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.522782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:29.614967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:29.616941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:29.626516 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.627334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:29.628463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.629198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:29.709878 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:29.726174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:29.729891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:29.732701 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e12fa0c2-0d6d-4fc2-9283-136ee1fed9dc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.237471 Jun 17 07:20:29.734733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 52/105] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:29 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:29.783048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:29.793188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-29dcbe44-8a9d-430a-8f42-943253bcd380 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.184501 Jun 17 07:20:29.795115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 54/106] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:29 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:29.885245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:29.886159 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:29.893747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.894864 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:29.896918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:29.897511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.058740 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:30.059822 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:30.070129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.070859 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.073098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.077041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.098374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:30.116342 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cec6c54f-e52b-4ebd-8beb-96f915e5aab9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.236557 Jun 17 07:20:30.125055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 53/107] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:29 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:30.356431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:30.374148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cf37c749-b6f4-42dc-bfc9-86ea12d8b58f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.313954 Jun 17 07:20:30.375744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 55/108] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:30 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:30.728799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-94c47242-3c68-43fc-8db9-d561ca1a8325 req-96a49fae-0e5c-4173-84f3-c0adb68c8275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a8c90c-c561-4193-8276-ae0351b550f4", "name": "network-vif-plugged", "status": "completed", "tag": "b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:30.753308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:30.755005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:30.760881 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-94c47242-3c68-43fc-8db9-d561ca1a8325 req-96a49fae-0e5c-4173-84f3-c0adb68c8275 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.761882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-94c47242-3c68-43fc-8db9-d561ca1a8325 req-96a49fae-0e5c-4173-84f3-c0adb68c8275 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.766422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.767217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.769454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.770915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.783868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-94c47242-3c68-43fc-8db9-d561ca1a8325 req-96a49fae-0e5c-4173-84f3-c0adb68c8275 service nova] Creating event network-vif-plugged:b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c for instance 73a8c90c-c561-4193-8276-ae0351b550f4 on hv-cinder-83482 Jun 17 07:20:30.790783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-94c47242-3c68-43fc-8db9-d561ca1a8325 req-96a49fae-0e5c-4173-84f3-c0adb68c8275 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068037 Jun 17 07:20:30.792506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 54/109] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:30.827757 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:30.830957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:30.840337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.856603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:30.858005 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:30.859955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:31.033288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.058978 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.061444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.064233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d53ade40-e48f-4b71-b4c1-d19210fc0004 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.315222 Jun 17 07:20:31.065227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 56/110] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:30 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:31.087446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.107956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-64347df0-5aa7-437d-a7c9-07fc2f48e1c8 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.297966 Jun 17 07:20:31.116229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 55/111] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:30 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:31.141073 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:31.142035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:31.153498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:31.155907 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:31.157096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:31.158558 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:31.407788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:31.409226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:31.417968 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:31.418760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:31.419793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:31.420440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:31.615677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.633586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-31f1ee76-e2fe-4991-8dc6-82f4a755dfe6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.229911 Jun 17 07:20:31.633586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 56/112] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:31 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:31.655363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:31.665434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c3374e7e-a57e-489b-8925-e2f991876d00 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.533912 Jun 17 07:20:31.673044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 57/113] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:31 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:32.082750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:32.083892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:32.090882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.091414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.092361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.092871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.126964 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:32.127604 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:32.134646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.142686 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.143768 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.144454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.274579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.286023 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.288695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.290995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ebcbabac-8179-4b35-bb08-095e8c1d2306 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.211886 Jun 17 07:20:32.291410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 57/114] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:32 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:32.300049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.309791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4ae7ed35-0126-49f3-b681-82fe303a317e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.187662 Jun 17 07:20:32.319330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 58/115] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:32 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:32.651727 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:32.652364 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:32.658638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.659311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.660511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.660940 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.682945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:32.683821 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:32.691380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.694509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.704911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.705421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.831384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.841053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0e108356-9276-4542-8f3a-92757ac6d66a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1363 microversion: 2.1 time: 0.195045 Jun 17 07:20:32.842301 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 58/116] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:32 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:32.850002 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-3acd5471-8167-4b5d-9dbb-8bc50b8f8fd7 req-fa97b4ce-2eb2-4509-9c0b-afe77028a847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "name": "network-vif-plugged", "status": "completed", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:32.863520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-3acd5471-8167-4b5d-9dbb-8bc50b8f8fd7 req-fa97b4ce-2eb2-4509-9c0b-afe77028a847 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:32.864307 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-3acd5471-8167-4b5d-9dbb-8bc50b8f8fd7 req-fa97b4ce-2eb2-4509-9c0b-afe77028a847 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:32.876686 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-3acd5471-8167-4b5d-9dbb-8bc50b8f8fd7 req-fa97b4ce-2eb2-4509-9c0b-afe77028a847 service nova] Creating event network-vif-plugged:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:20:32.885194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-3acd5471-8167-4b5d-9dbb-8bc50b8f8fd7 req-fa97b4ce-2eb2-4509-9c0b-afe77028a847 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041461 Jun 17 07:20:32.885994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 59/117] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:32.886640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:32.894504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b45c7e46-0554-406e-bcf5-32962a5e6d29 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.215704 Jun 17 07:20:32.895255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 59/118] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:32 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:33.309503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:33.310103 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:33.316954 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.317415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.318249 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.318677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.327244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:33.328553 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:33.343961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.344441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.345401 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.345844 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.488780 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:33.489811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:33.502633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-dc9a6927-6eb7-4630-9834-78bcf9fdfa4b tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.174016 Jun 17 07:20:33.502633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:33 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:33.502938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:33.502938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:33.502938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e49d2d73-46b2-4fc4-b90d-445ef6704dde tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.197430 Jun 17 07:20:33.503215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 60/120] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:33 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:33.858630 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:33.859180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:33.865294 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.865746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.866563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.867004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.911934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:33.912570 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:33.919232 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.919983 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:33.920707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:33.921145 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.017514 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:34.025701 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e30119df-2ab7-43a3-901d-58be24cae8fa tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1547 microversion: 2.1 time: 0.171009 Jun 17 07:20:34.026397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 61/121] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:33 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:34.048188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:34.048889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:34.055359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.056318 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.057150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.057598 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.100162 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:34.108358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f8401f28-9611-4c83-847f-bce9ad8a8e75 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.200570 Jun 17 07:20:34.108989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 61/122] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:33 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:34.178651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b63d34d7-5443-43c1-a865-1d74f5dff0cb tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134372 Jun 17 07:20:34.179537 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 62/123] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:20:34 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:34.527287 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:34.527899 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:34.528995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:34.530068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:34.544316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.546627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.546919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.549041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.550057 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.550175 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.550518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.552492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.790004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:34.799571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:34.801098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:34.802215 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2cd677a2-705c-450b-bb11-cc70e0c21293 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1408 microversion: 2.20 time: 0.283451 Jun 17 07:20:34.802759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 63/124] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:34 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:34.901399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d88b5d-9a22-4092-a847-ca3fdb686228", "name": "network-vif-plugged", "status": "completed", "tag": "b91810a2-f141-4e45-96ab-9963b0a82c19"}, {"server_uuid": "bbd2b266-655e-4605-8db4-c708addf8e80", "name": "network-vif-plugged", "status": "completed", "tag": "2b54f26a-5895-4258-b7f5-aa5845feef41"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:34.912497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:34.912940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:34.927503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] Creating event network-vif-plugged:b91810a2-f141-4e45-96ab-9963b0a82c19 for instance 12d88b5d-9a22-4092-a847-ca3fdb686228 on hv-cinder-83482 Jun 17 07:20:34.928025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] Creating event network-vif-plugged:2b54f26a-5895-4258-b7f5-aa5845feef41 for instance bbd2b266-655e-4605-8db4-c708addf8e80 on hv-cinder-83482 Jun 17 07:20:34.935512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-1567211e-e5ab-4fe8-94a6-5d4ab4dafe16 req-b693d6f4-5720-4588-84aa-d32a514c5758 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038389 Jun 17 07:20:34.936157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 64/125] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:35.126203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:35.126984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:35.135160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:35.135656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:35.136460 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:35.136888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:35.173240 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:35.182581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8e361d06-e0a5-47dd-b32a-dc1d763cd02c tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.668341 Jun 17 07:20:35.183317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 62/126] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:34 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:35.299068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:35.308729 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6a9e433c-c243-4ae9-8a93-626b538bcd44 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.187236 Jun 17 07:20:35.309590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 65/127] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:35 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:35.834258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:35.836047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:35.859907 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:35.862913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:35.864768 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:35.865373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:35.983540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-2fc4fbb3-571e-4bdb-8bb4-5830d7033004 req-5895d71a-b08d-4a5c-9fc8-5407c95486d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73a8c90c-c561-4193-8276-ae0351b550f4", "tag": "b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:35.999891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2fc4fbb3-571e-4bdb-8bb4-5830d7033004 req-5895d71a-b08d-4a5c-9fc8-5407c95486d2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.000334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2fc4fbb3-571e-4bdb-8bb4-5830d7033004 req-5895d71a-b08d-4a5c-9fc8-5407c95486d2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.015129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-2fc4fbb3-571e-4bdb-8bb4-5830d7033004 req-5895d71a-b08d-4a5c-9fc8-5407c95486d2 service nova] Creating event network-changed:b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c for instance 73a8c90c-c561-4193-8276-ae0351b550f4 on hv-cinder-83482 Jun 17 07:20:36.032228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-2fc4fbb3-571e-4bdb-8bb4-5830d7033004 req-5895d71a-b08d-4a5c-9fc8-5407c95486d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Jun 17 07:20:36.038818 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 66/128] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:36.137945 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:36.149690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:36.154585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:36.157015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8d3520c5-149b-452c-b07d-801f92998b6a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1599 microversion: 2.20 time: 0.339632 Jun 17 07:20:36.158392 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 63/129] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:20:35 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1599 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:20:36.181767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:36.183601 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:36.191657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.192686 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.193819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.194670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.200004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:36.200724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:36.213145 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.214068 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.214938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.216041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.395281 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ae944799-e027-4e81-ac44-7dc1bee7b535 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.220181 Jun 17 07:20:36.396279 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 67/130] 10.222.0.33 () {60 vars in 1315 bytes} [Fri Jun 17 07:20:36 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:20:36.405979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:36.409668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:36.436618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.437607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.441678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:36.442193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:36.607867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:36.612688 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:36.623224 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9d438181-2b5a-45d3-b55d-405b6b63b38f tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1314 microversion: 2.1 time: 0.426799 Jun 17 07:20:36.623874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 64/131] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:36 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:36.851759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:36.863389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3bc3b480-2465-4fb5-b235-7462ad107465 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1321 microversion: 2.1 time: 0.465003 Jun 17 07:20:36.864374 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 68/132] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:36 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:37.643224 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:37.644536 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:37.661143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:37.661859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:37.662835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:37.663414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:37.884751 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:37.886075 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:37.893369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:37.894132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:37.895257 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:37.896021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.069682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:38.090788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-854079fc-542c-4d79-964d-bd20762eac48 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1502 microversion: 2.1 time: 0.454146 Jun 17 07:20:38.092019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 65/133] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:37 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1502 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:38.166042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:38.171865 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:38.186016 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-41f61f75-e39d-4386-a41b-6468886094a3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1514 microversion: 2.1 time: 0.308769 Jun 17 07:20:38.198696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 69/134] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:37 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1514 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:38.203743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:38.204800 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:38.212964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:38.213302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.214070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:38.214513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.291932 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'flavor' on Instance uuid 12d88b5d-9a22-4092-a847-ca3fdb686228 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:20:38.480942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-04b11992-ea9d-4a06-889a-e0bf4c49aee6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228/action" status: 200 len: 32 microversion: 2.1 time: 0.280272 Jun 17 07:20:38.482073 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 66/135] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:20:38 2022] POST /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 07:20:38.491372 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:38.491965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:38.508733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:38.509354 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.529796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:38.531041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.624295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-da19bac8-888f-499f-98cd-e2a124227198 req-b097c3d6-2b5d-46de-a1b7-04104e49e97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:38.643298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-da19bac8-888f-499f-98cd-e2a124227198 req-b097c3d6-2b5d-46de-a1b7-04104e49e97d service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:38.644866 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-da19bac8-888f-499f-98cd-e2a124227198 req-b097c3d6-2b5d-46de-a1b7-04104e49e97d service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:38.671525 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-da19bac8-888f-499f-98cd-e2a124227198 req-b097c3d6-2b5d-46de-a1b7-04104e49e97d service nova] Creating event network-changed:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:20:38.687330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-da19bac8-888f-499f-98cd-e2a124227198 req-b097c3d6-2b5d-46de-a1b7-04104e49e97d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069068 Jun 17 07:20:38.690612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 67/136] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:20:38.894973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:38.907551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bd1b0a18-1439-4b44-870b-2f644c6913dc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.420712 Jun 17 07:20:38.911312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 70/137] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:38 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:39.904035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d007972-df79-446f-bb74-e4ba8954b88d"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:39.905780 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:39.912653 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:39.913284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:39.914923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:39.915483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:39.928866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:39.930187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:39.941362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:39.944792 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:39.944967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:39.945548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:40.293311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:40.306100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4437f8e7-7c7a-4dd5-90f1-d85837b24d9a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.381400 Jun 17 07:20:40.326267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 71/138] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:39 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:40.736218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1835f39f-0518-40da-a0a2-155ec263395e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "POST /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835446 Jun 17 07:20:40.742714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 68/139] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:20:39 2022] POST /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:41.327127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:41.327848 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:41.343451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:41.344476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:41.346380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:41.348007 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:41.691151 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:41.701493 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fb899e71-d765-4c33-b151-96b083d17d2e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.379982 Jun 17 07:20:41.712733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 72/140] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:41 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:42.720915 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:42.723079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:42.731219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=89 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:42.734104 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:42.734665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:42.735651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:42.736116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:42.893016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:42.903703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-71de4d13-c97f-4561-8873-78db1784c060 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.189523 Jun 17 07:20:42.904875 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 69/141] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:42 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:43.921250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:43.921842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:43.928769 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:43.929618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:43.930009 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:43.930448 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:44.087292 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:44.095408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7eca11cd-8fb2-4970-809b-712f686e60a6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.177977 Jun 17 07:20:44.096145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 73/142] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:43 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:45.112442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:45.113049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:45.120270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:45.120953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:45.121844 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:45.122363 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:45.265037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:45.283371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b5e1e30a-b2e6-48b7-b5dd-e8da657f9c09 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.166732 Jun 17 07:20:45.283988 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 70/143] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:45 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:46.301244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:46.302638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:46.309017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:46.309459 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:46.310344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:46.310638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:46.439495 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:46.447435 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-39ebac94-8918-4e4f-be0b-cbd894d86b19 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.150035 Jun 17 07:20:46.447996 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 74/144] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:46 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:47.464439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:47.465041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:47.472103 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:47.472521 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:47.478225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:47.478225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:47.606379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:47.614455 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9fefdd83-9e98-4b54-85a0-1e356c2695d4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.153726 Jun 17 07:20:47.615722 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 71/145] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:47 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:48.631313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:48.632016 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:48.638062 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:48.638504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:48.639246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:48.639671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:48.766359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:48.774717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f4f9d5cc-16e7-454c-9dd0-287662c01e92 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.146988 Jun 17 07:20:48.775507 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 75/146] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:48 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:49.371168 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:49.371642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:49.378218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.378659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.379426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.379902 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.406355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:20:49.493755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-84e653b8-03b4-48ef-87f8-2c8736233765 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 204 len: 0 microversion: 2.1 time: 0.126059 Jun 17 07:20:49.494355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 72/147] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:20:49 2022] DELETE /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:20:49.503183 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:49.503832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:49.510010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.510503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.511266 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.511699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.645142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:49.653656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fa02db4e-c760-4caf-97f6-502ea1bf9ec7 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1554 microversion: 2.1 time: 0.154446 Jun 17 07:20:49.654217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 76/148] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:49 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:49.794446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:49.794740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:49.800613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.801070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.801831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:49.802270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:49.933840 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:49.941672 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7af46d6b-ed25-457f-a57e-a902b0e0e30a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.152658 Jun 17 07:20:49.942273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 73/149] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:49 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:50.671465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:50.672013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:50.679674 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:50.680173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:50.681122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:50.681549 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:50.811179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:50.819699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5a1eec0d-8d86-47af-99bd-5bf34cd2afca tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1554 microversion: 2.1 time: 0.152052 Jun 17 07:20:50.820359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 77/150] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:50 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:50.959080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:50.959694 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:50.966853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:50.967302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:50.968055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:50.968510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:51.099895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:51.107759 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e37a1bd6-7b20-4b24-9a01-dc856c44edee tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.152483 Jun 17 07:20:51.108361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 74/151] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:50 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:51.837351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:51.838132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:51.845297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:51.845745 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:51.846515 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:51.846950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:52.046054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:52.054637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-22992f36-85d3-41b2-8c46-fa6348066de6 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1554 microversion: 2.1 time: 0.220970 Jun 17 07:20:52.055131 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 78/152] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:51 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:52.124982 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:52.125677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:52.132537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:52.133060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:52.133890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:52.134394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:52.388332 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:52.397704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-01cd29de-3e44-4589-8bbd-9410c9365c39 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.276481 Jun 17 07:20:52.398292 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 75/153] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:52 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:52.881490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-f67cb9a3-29e6-4f3c-a8b5-4c19768ac43a req-272ab471-a703-4cff-b739-cbfcce844f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd2b266-655e-4605-8db4-c708addf8e80", "name": "network-vif-deleted", "tag": "2b54f26a-5895-4258-b7f5-aa5845feef41"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:52.898999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-f67cb9a3-29e6-4f3c-a8b5-4c19768ac43a req-272ab471-a703-4cff-b739-cbfcce844f4c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:52.899759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-f67cb9a3-29e6-4f3c-a8b5-4c19768ac43a req-272ab471-a703-4cff-b739-cbfcce844f4c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:52.939592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-f67cb9a3-29e6-4f3c-a8b5-4c19768ac43a req-272ab471-a703-4cff-b739-cbfcce844f4c service nova] Creating event network-vif-deleted:2b54f26a-5895-4258-b7f5-aa5845feef41 for instance bbd2b266-655e-4605-8db4-c708addf8e80 on hv-cinder-83482 Jun 17 07:20:52.946647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-f67cb9a3-29e6-4f3c-a8b5-4c19768ac43a req-272ab471-a703-4cff-b739-cbfcce844f4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078481 Jun 17 07:20:52.947271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 79/154] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:20:53.072644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:53.073177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:53.079169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:53.079796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:53.080570 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:53.081164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:53.298660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d04750a83fb465e8fba24c1143d4eff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09dfc5c0d3f4405a901acd8eeef080b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:53.308368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-099b6fc1-e3c5-4453-b05a-1f5b365d3dce tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 200 len: 1345 microversion: 2.1 time: 0.239622 Jun 17 07:20:53.309103 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 76/155] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:53 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 1345 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:53.416796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:53.417743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:53.419789 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=71 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:53.425797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:53.426492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:53.427681 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:53.428333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:53.577512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:53.584945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ea0c58ea-0362-4278-9174-1d389c95ccf0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.173202 Jun 17 07:20:53.585506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 80/156] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:53 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:54.328606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:54.329271 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:54.336740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.337189 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.337979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.338411 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.342500 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:54.353171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] HTTP exception thrown: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Request method failure captured: Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 HTTP/1.1 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsdYc005T3PLekucsm2dHT84fbtg6jr-RPd4yM-PpqbQcMXaCJcXSZUPiWHY8BP6t8dA2L0Tb9vZUtE1cA1chLBvd6vXvwCX5H3aryn5u6bl8B3zu0I91K43BGLIM9jB_ndD3hnwX4-oFQvuvrWfX0ol5cZInR9SJ9gLVGNfV45wJM Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:20:54.368485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 6d04750a83fb465e8fba24c1143d4eff Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.370527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': 'bbd2b266-655e-4605-8db4-c708addf8e80'} Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:20:54.371354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.372532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.373647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Returning 404 to user: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:20:54.373647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9f778dc4-e75b-481a-b592-2eaafa8e52a0 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 404 len: 111 microversion: 2.1 time: 0.046736 Jun 17 07:20:54.373647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 77/157] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:54 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:20:54.489774 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:54.490705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:54.503028 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.503475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.504311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.504742 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.518702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] HTTP exception thrown: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Request method failure captured: Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80/os-volume_attachments HTTP/1.1 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsdYc005T3PLekucsm2dHT84fbtg6jr-RPd4yM-PpqbQcMXaCJcXSZUPiWHY8BP6t8dA2L0Tb9vZUtE1cA1chLBvd6vXvwCX5H3aryn5u6bl8B3zu0I91K43BGLIM9jB_ndD3hnwX4-oFQvuvrWfX0ol5cZInR9SJ9gLVGNfV45wJM Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:20:54.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6d04750a83fb465e8fba24c1143d4eff Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.524476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'server_id': 'bbd2b266-655e-4605-8db4-c708addf8e80'} Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:20:54.525241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:54.526519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:54.527811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Returning 404 to user: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:20:54.527811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-31bb4cd4-c0c4-4368-9090-802ddf58ce90 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038506 Jun 17 07:20:54.527811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 81/158] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:20:54 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:20:54.608400 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:54.609006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:54.627056 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.629260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.632356 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:54.633139 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:54.861217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:54.870795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0c0711ea-af78-4459-be5e-bb3647edacff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.267287 Jun 17 07:20:54.871979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 78/159] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:54 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:55.739291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:55.739794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:55.746625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.747073 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:55.747835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.748394 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:55.762398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] HTTP exception thrown: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Request method failure captured: Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 HTTP/1.1 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsdYc005T3PLekucsm2dHT84fbtg6jr-RPd4yM-PpqbQcMXaCJcXSZUPiWHY8BP6t8dA2L0Tb9vZUtE1cA1chLBvd6vXvwCX5H3aryn5u6bl8B3zu0I91K43BGLIM9jB_ndD3hnwX4-oFQvuvrWfX0ol5cZInR9SJ9gLVGNfV45wJM Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:20:55.766647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6d04750a83fb465e8fba24c1143d4eff Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.768161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'bbd2b266-655e-4605-8db4-c708addf8e80'} Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:20:55.769254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.770393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.771658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Returning 404 to user: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:20:55.771658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-927ff46e-f442-4ecb-9197-7e3fc3e38b0e tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 404 len: 111 microversion: 2.1 time: 0.030566 Jun 17 07:20:55.771658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 82/160] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:20:55 2022] DELETE /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:20:55.774295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:55.774924 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] [instance: bbd2b266-655e-4605-8db4-c708addf8e80] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:55.781691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.782140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:55.782891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.783324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:55.796879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] HTTP exception thrown: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Request method failure captured: Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 HTTP/1.1 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsdYc005T3PLekucsm2dHT84fbtg6jr-RPd4yM-PpqbQcMXaCJcXSZUPiWHY8BP6t8dA2L0Tb9vZUtE1cA1chLBvd6vXvwCX5H3aryn5u6bl8B3zu0I91K43BGLIM9jB_ndD3hnwX4-oFQvuvrWfX0ol5cZInR9SJ9gLVGNfV45wJM Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:20:55.798420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/09dfc5c0d3f4405a901acd8eeef080b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 09dfc5c0d3f4405a901acd8eeef080b9 Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-DeleteServersTestJSON-55594728 Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 6d04750a83fb465e8fba24c1143d4eff Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-DeleteServersTestJSON-55594728-project Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.799634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': 'bbd2b266-655e-4605-8db4-c708addf8e80'} Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:20:55.800324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. Jun 17 07:20:55.801336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:20:55.802277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] Returning 404 to user: Instance bbd2b266-655e-4605-8db4-c708addf8e80 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:20:55.802277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-76f15262-b23c-403b-a683-8a23019089c1 tempest-DeleteServersTestJSON-55594728 tempest-DeleteServersTestJSON-55594728-project] 10.222.0.33 "GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80" status: 404 len: 111 microversion: 2.1 time: 0.029299 Jun 17 07:20:55.802277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 79/161] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:55 2022] GET /compute/v2.1/servers/bbd2b266-655e-4605-8db4-c708addf8e80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:20:55.887939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:55.888606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:55.894501 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.894952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:55.895713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:55.896170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:56.033200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:56.040855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-069b843a-fd5f-4e9b-b804-fd4d23e66514 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.156758 Jun 17 07:20:56.041418 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 83/162] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:55 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:56.731796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-923444980", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "networks": [{"uuid": "1236b686-194b-46a8-a3de-bb596b3f531d"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:20:57.060791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:57.061389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:57.068174 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:57.068619 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:57.069379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:57.069977 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:57.217240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:57.226329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2246eafd-c262-4edd-b10f-5caf68d0e472 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.169499 Jun 17 07:20:57.227164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 84/163] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:57 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:58.243011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:58.243634 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:58.255426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:58.255883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:58.256767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:58.257368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:58.423850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:58.442923 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-375c31ca-5890-45ac-9e4c-f57b8579e7a4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.203714 Jun 17 07:20:58.443878 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 85/164] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:58 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:20:59.263418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] validate_networks() for [('1236b686-194b-46a8-a3de-bb596b3f531d', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:20:59.462950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:59.463568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:59.469823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:59.470377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:59.471157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:59.471737 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:59.600951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:59.609067 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-538e705d-5bd5-4030-a6cc-3e7e97d7e129 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.150205 Jun 17 07:20:59.609642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 86/165] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:59 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:20:59.729559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:20:59.729985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:20:59.730461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:20:59.730923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:20:59.731336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:20:59.740832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:59.741253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:59.742105 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:20:59.742540 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:20:59.764338 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Getting quotas for project 656ac358f6f44d7180b1122e87dc9c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:20:59.768690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Getting quotas for user 9710f6fb31da4df39b04839a29dfdb34 and project 656ac358f6f44d7180b1122e87dc9c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:20:59.783257 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:20:59.785657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:20:59.841040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2aa938b1-7185-4bbf-a9d7-7af8fcef0414 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.112860 Jun 17 07:20:59.846361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 80/166] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:20:59.852794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a10e5b36-5ede-49e9-8ba0-6c72ef3d7e73 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:20:59.853563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a10e5b36-5ede-49e9-8ba0-6c72ef3d7e73 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:20:59.930322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a10e5b36-5ede-49e9-8ba0-6c72ef3d7e73 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:20:59.939575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a10e5b36-5ede-49e9-8ba0-6c72ef3d7e73 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1213 microversion: 2.1 time: 0.090442 Jun 17 07:20:59.949524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 87/167] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:20:59 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:00.626944 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:00.627668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:00.634729 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:00.635178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:00.636638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:00.637134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:00.767812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:00.777070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-93fb88b5-28b5-4a7d-9e45-0e98017c33ae tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.154283 Jun 17 07:21:00.777649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 81/168] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:00 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:00.958558 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:00.959199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:00.966469 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:00.967501 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:00.968313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:00.968900 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:01.040559 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:01.049932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c291ed6d-d948-4354-8521-86fbf5b27e90 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1265 microversion: 2.1 time: 0.096619 Jun 17 07:21:01.051162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 88/169] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:00 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:01.798630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:01.799305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:01.808320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:01.809026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:01.809802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:01.810239 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:02.047480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:02.055490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0c2d50d0-d0f9-454a-8e41-7ab707be4ef2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.260989 Jun 17 07:21:02.055934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 82/170] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:01 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:02.069392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:02.071094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:02.077635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:02.078078 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:02.078926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:02.079346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:02.097699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:02.217696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:02.225426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-95fdc298-d09f-45b3-a147-0c4c4762a292 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.160368 Jun 17 07:21:02.225981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 89/171] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:02 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:02.721400 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-8a77a31d-c5d4-4746-9e3c-aa90d35c3c5d req-668e6513-0670-4ae4-8d35-265d69368e5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03ad911-d38e-4c61-b346-9e0b7f991586", "tag": "8b9dab27-3f0b-4e8a-ab07-6dc714bda77c"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:02.748427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-8a77a31d-c5d4-4746-9e3c-aa90d35c3c5d req-668e6513-0670-4ae4-8d35-265d69368e5e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:02.750519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-8a77a31d-c5d4-4746-9e3c-aa90d35c3c5d req-668e6513-0670-4ae4-8d35-265d69368e5e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:02.765112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-8a77a31d-c5d4-4746-9e3c-aa90d35c3c5d req-668e6513-0670-4ae4-8d35-265d69368e5e service nova] Creating event network-changed:8b9dab27-3f0b-4e8a-ab07-6dc714bda77c for instance d03ad911-d38e-4c61-b346-9e0b7f991586 on hv-cinder-83482 Jun 17 07:21:02.770319 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-8a77a31d-c5d4-4746-9e3c-aa90d35c3c5d req-668e6513-0670-4ae4-8d35-265d69368e5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053898 Jun 17 07:21:02.771103 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 83/172] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:03.072975 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:03.074136 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:03.080215 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:03.080658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:03.081404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:03.081830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:03.218519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:03.226037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b1e36e25-363b-492a-8b03-35c118911572 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.156919 Jun 17 07:21:03.226603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 90/173] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:03 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:03.244172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:03.245449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:03.251593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:03.252041 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:03.252822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:03.253257 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:03.383573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:03.391273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9c05b5e8-edc4-4be4-8e7a-2f8705f8b1c4 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.152292 Jun 17 07:21:03.392023 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 84/174] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:03 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:04.243669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:04.244303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:04.250390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:04.250840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:04.251594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:04.252225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:04.375415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:04.382839 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7a3a222e-00e4-4afe-b616-26f48497ae2b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.143583 Jun 17 07:21:04.383399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 91/175] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:04 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:04.408216 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:04.408821 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:04.415580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:04.416017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:04.416854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:04.417288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:04.540695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:04.548060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-70808b60-1c0c-4ffb-bb94-a79268d14f65 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.143712 Jun 17 07:21:04.548643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 85/176] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:04 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:05.403407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:05.405094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:05.412752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:05.413628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:05.414577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:05.415202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:05.564615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:05.565226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:05.566353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:05.571681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:05.572152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:05.572936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:05.573531 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:05.575011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d1a9588d-029e-45cc-b819-df7d60963815 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.179071 Jun 17 07:21:05.575660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 92/177] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:05 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:05.721672 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:05.729063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-edabb719-b1d4-48bb-8335-417af6d9c350 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.168257 Jun 17 07:21:05.729640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 86/178] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:05 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:06.592242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:06.592857 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:06.598988 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:06.599425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:06.600197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:06.600622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:06.746516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:06.748039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:06.758994 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:06.763475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:06.765518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:06.767488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:06.769263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:06.775735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8671602d-82ed-4b3f-9bba-dd450f7c49f9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.187127 Jun 17 07:21:06.776916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 93/179] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:06 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:06.970755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:06.978254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-77e1d048-0d6a-4bc8-a72e-1df79122e67a tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.236173 Jun 17 07:21:06.978828 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 87/180] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:06 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:07.793352 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:07.794013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:07.800021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:07.800485 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:07.801228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:07.802015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:07.932127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:07.940841 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3eab99d7-b8a6-4b6b-a402-2d7413d54a2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.150867 Jun 17 07:21:07.941687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 94/181] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:07 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:07.994445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:07.995610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:08.002121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:08.002602 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:08.003372 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:08.003811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:08.157547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:08.165829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-01759ff7-66d6-4943-97c8-0204f18a9de1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.175023 Jun 17 07:21:08.166414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 88/182] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:07 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:08.414126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-851978a3-d89b-48cb-81d1-7b0d40ba1201 req-dfc39adf-d13b-42c5-b8d2-8ca21bb313fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03ad911-d38e-4c61-b346-9e0b7f991586", "name": "network-vif-plugged", "status": "completed", "tag": "8b9dab27-3f0b-4e8a-ab07-6dc714bda77c"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:08.423257 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-851978a3-d89b-48cb-81d1-7b0d40ba1201 req-dfc39adf-d13b-42c5-b8d2-8ca21bb313fe service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:08.423704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-851978a3-d89b-48cb-81d1-7b0d40ba1201 req-dfc39adf-d13b-42c5-b8d2-8ca21bb313fe service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:08.435493 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-851978a3-d89b-48cb-81d1-7b0d40ba1201 req-dfc39adf-d13b-42c5-b8d2-8ca21bb313fe service nova] Creating event network-vif-plugged:8b9dab27-3f0b-4e8a-ab07-6dc714bda77c for instance d03ad911-d38e-4c61-b346-9e0b7f991586 on hv-cinder-83482 Jun 17 07:21:08.440380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-851978a3-d89b-48cb-81d1-7b0d40ba1201 req-dfc39adf-d13b-42c5-b8d2-8ca21bb313fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031193 Jun 17 07:21:08.441122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 95/183] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:08.956806 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:08.957442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:08.963390 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:08.964483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:08.965234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:08.965665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:09.091739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:09.099112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-01f5f15d-ffcb-4382-a128-137e1e0e07cc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.146157 Jun 17 07:21:09.099677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 89/184] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:08 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:09.183303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:09.183987 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:09.190753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:09.191190 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:09.191929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:09.192391 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:09.324691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:09.332115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-011cc17c-bfe8-4845-8c8a-55e78a6b9c88 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.153360 Jun 17 07:21:09.332671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 96/185] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:09 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:10.116262 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:10.116871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:10.118811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:10.119491 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:10.126156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:10.126601 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:10.127360 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:10.127793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:10.259548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:10.267900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-efe7bf74-6df9-42f1-9ccc-05b72df43724 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.155835 Jun 17 07:21:10.268574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 90/186] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:10 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:10.347901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:10.348558 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:10.350642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:10.355919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:10.356392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:10.357154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:10.357583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:10.482847 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:10.490378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-55653f13-d507-46e1-b9f3-4cb7dc67cf45 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.146350 Jun 17 07:21:10.490942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 97/187] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:10 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:11.284800 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:11.285409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:11.292209 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:11.292660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:11.293425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:11.293883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:11.427679 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:11.435777 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-80f2b756-c62d-4e91-a21e-ab24af36de48 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.154817 Jun 17 07:21:11.436423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 91/188] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:11 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:11.506678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:11.507282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:11.513920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:11.514365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:11.515123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:11.515551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:11.642610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:11.650480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-101ef310-7b41-487b-8b27-7bfa2b60fc4c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.147724 Jun 17 07:21:11.651611 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 98/189] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:11 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:12.452503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:12.453111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:12.459614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:12.460053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:12.460835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:12.461263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:12.594647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:12.602262 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-883c51ae-4795-4b3e-b293-39890d3d66fa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.153614 Jun 17 07:21:12.602826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 92/190] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:12 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:12.669053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:12.669781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:12.676010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:12.676552 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:12.677380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:12.677819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:13.013242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:13.020736 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-471ff0eb-f807-4f02-bc56-8b4c6e622b33 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1313 microversion: 2.1 time: 0.356009 Jun 17 07:21:13.021304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 99/191] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:12 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:13.618750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:13.619299 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:13.622160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:13.627503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:13.627951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:13.628742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:13.629186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:13.753285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:13.761350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-32ab0e03-ce44-4664-bbab-a0b6382bfd22 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.146480 Jun 17 07:21:13.761911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 93/192] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:13 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:14.038143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:14.038753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:14.045293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:14.045743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:14.046497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:14.046940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:14.169793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:14.177254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d17f1cee-a5b6-48ae-bdd1-b95715af3e46 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1497 microversion: 2.1 time: 0.143191 Jun 17 07:21:14.177819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 100/193] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:14 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:14.778693 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:14.779418 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:14.786296 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:14.786738 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:14.787774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:14.788214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:14.915279 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:14.922793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fc346f0a-58e1-42da-ac8e-15b289c62093 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.148636 Jun 17 07:21:14.923358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 94/194] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:14 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:15.939520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:15.940679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:15.946749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:15.947210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:15.948571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:15.948991 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:16.080242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:16.087799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2a98c6e5-5721-444c-a787-ac1fd64620e6 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1520 microversion: 2.1 time: 0.152279 Jun 17 07:21:16.088442 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 101/195] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:15 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:16.462625 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:16.463129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:16.470473 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:16.470925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:16.471681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:16.472154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:16.496802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:21:16.525611 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:16.575532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-af7de2bf-335f-4bf3-a7d3-c9cfb771fc40 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 204 len: 0 microversion: 2.1 time: 0.116490 Jun 17 07:21:16.576123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 95/196] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:21:16 2022] DELETE /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:21:16.584246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:16.584881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:16.590858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:16.591305 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:16.592056 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:16.593776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:16.723385 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:16.730742 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4c298a91-46aa-4609-b13d-0652a6634dc8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1503 microversion: 2.1 time: 0.150421 Jun 17 07:21:16.731302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 102/197] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:16 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:17.105789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:17.106492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:17.112522 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.112971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.113729 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.114166 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.251276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:17.258970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d5e36af3-7bf3-4b47-aa5b-9ffd770a5798 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1500 microversion: 2.1 time: 0.157935 Jun 17 07:21:17.260834 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 96/198] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:17 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:17.276667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:17.277326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:17.283385 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.283829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.284682 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.285109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.416259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:17.424496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9cbe877c-ac05-416c-bcaa-2bff0073fcf3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1515 microversion: 2.1 time: 0.151963 Jun 17 07:21:17.425070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 103/199] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:17 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:17.747398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:17.747992 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:17.754701 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.755146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.755915 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:17.756376 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:17.893463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:17.901761 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-abca6a9e-ac6d-4739-8c5b-d4bd864c6bdb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1503 microversion: 2.1 time: 0.158052 Jun 17 07:21:17.902206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 97/200] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:17 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:18.773134 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:18.774118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:18.780021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.780506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:18.781259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.781693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:18.804353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'flavor' on Instance uuid 5420c538-ebd6-4349-934d-9cd2d5ec2cfc {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:18.911648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:18.920652 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:18.921222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:18.928011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.928497 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:18.930064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.930064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:18.931899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0f04491a-0591-4d3e-a6ce-f1dcffeff6c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/action" status: 200 len: 32 microversion: 2.1 time: 0.162758 Jun 17 07:21:18.933362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 104/201] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:21:18 2022] POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:21:18.945008 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:18.946054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:18.953592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.954042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:18.954812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:18.955248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:19.169234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:19.176996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a575fbd4-3262-4ae7-a97b-176a004d6a27 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1503 microversion: 2.1 time: 0.261044 Jun 17 07:21:19.178377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 98/202] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:18 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:19.284904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:19.298825 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4e38798d-c42b-4d62-a5b3-62aaacd1d688 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.359351 Jun 17 07:21:19.300397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 105/203] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:18 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:19.689869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a8988a9b-ecba-4e2d-bd12-8db0f5ec0b3f req-990a7449-08d2-4942-81fb-ccdf3728dee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03ad911-d38e-4c61-b346-9e0b7f991586", "name": "network-vif-deleted", "tag": "8b9dab27-3f0b-4e8a-ab07-6dc714bda77c"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:19.699116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a8988a9b-ecba-4e2d-bd12-8db0f5ec0b3f req-990a7449-08d2-4942-81fb-ccdf3728dee0 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:19.699663 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a8988a9b-ecba-4e2d-bd12-8db0f5ec0b3f req-990a7449-08d2-4942-81fb-ccdf3728dee0 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:19.711355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a8988a9b-ecba-4e2d-bd12-8db0f5ec0b3f req-990a7449-08d2-4942-81fb-ccdf3728dee0 service nova] Creating event network-vif-deleted:8b9dab27-3f0b-4e8a-ab07-6dc714bda77c for instance d03ad911-d38e-4c61-b346-9e0b7f991586 on hv-cinder-83482 Jun 17 07:21:19.719255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a8988a9b-ecba-4e2d-bd12-8db0f5ec0b3f req-990a7449-08d2-4942-81fb-ccdf3728dee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033022 Jun 17 07:21:19.720156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 99/204] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:20.196531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:20.197318 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:20.204544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:20.205152 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:20.206058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:20.207080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:20.241876 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:20.242582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:20.243501 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lazy-loading 'fault' on Instance uuid d03ad911-d38e-4c61-b346-9e0b7f991586 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:20.308309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:20.317705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-88e4b327-970a-4b03-bd71-4ff4b2f3615b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 200 len: 1303 microversion: 2.1 time: 0.124867 Jun 17 07:21:20.318647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 106/205] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:20 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:20.321821 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:20.324480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:20.332200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:20.333117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:20.333946 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:20.334989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:20.495134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:20.505381 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cbdf0a38-5688-46ac-82c7-43feee6fd881 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.190969 Jun 17 07:21:20.505959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 100/206] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:20 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:21.337291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:21.339073 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: d03ad911-d38e-4c61-b346-9e0b7f991586] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:21.345825 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.346276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.347200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.347633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.363853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] HTTP exception thrown: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Request method failure captured: Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 HTTP/1.1 Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCtXNynrwsHFJHlDnU9H3BXS4Ix88L6ZAtz-kq5nfXkryPNw2dWh-ZCAZvR565egppRCSZHjYdmqJIA7bh4zNfIrVmtUUxleKtxazSkMFoIo0lyFciKv1CHlR15zwPU16qDpjtaO2eAH7f7GupbM2IsBFaOdIQ7uzIFcySsE7j9Qo8A Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 656ac358f6f44d7180b1122e87dc9c3e Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesActionsTest-988475808 Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:21:21.365434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesActionsTest-988475808 Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 656ac358f6f44d7180b1122e87dc9c3e Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesActionsTest-988475808 Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesActionsTest-988475808-project Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 9710f6fb31da4df39b04839a29dfdb34 Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesActionsTest-988475808-project Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. Jun 17 07:21:21.366761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'd03ad911-d38e-4c61-b346-9e0b7f991586'} Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:21:21.367698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. Jun 17 07:21:21.369001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:21:21.370159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Returning 404 to user: Instance d03ad911-d38e-4c61-b346-9e0b7f991586 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:21:21.370159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1273b85d-b310-430d-99a3-bdb5a20af26c tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586" status: 404 len: 111 microversion: 2.1 time: 0.034731 Jun 17 07:21:21.378578 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 107/207] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:21 2022] GET /compute/v2.1/servers/d03ad911-d38e-4c61-b346-9e0b7f991586 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:21:21.472876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1401396858", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "networks": [{"uuid": "1236b686-194b-46a8-a3de-bb596b3f531d"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:21.526793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:21.527643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:21.534330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] validate_networks() for [('1236b686-194b-46a8-a3de-bb596b3f531d', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:21:21.534878 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.535317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.536093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.536530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.682223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:21.691616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-84bfcbaf-4898-4c9f-8bd0-65eaca61efb9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.172807 Jun 17 07:21:21.692812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 108/208] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:21 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:21.942965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:21:21.943454 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:21:21.943918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:21:21.944268 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:21:21.944673 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:21:21.956595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.957353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.958373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:21.959106 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:21.980822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Getting quotas for project 656ac358f6f44d7180b1122e87dc9c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:21:21.984935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Getting quotas for user 9710f6fb31da4df39b04839a29dfdb34 and project 656ac358f6f44d7180b1122e87dc9c3e. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:21:21.996895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:21:21.999688 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:21:22.054698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-72aabb94-b16f-4697-8f40-e11590d2f045 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585489 Jun 17 07:21:22.055936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 101/209] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:21:22.066445 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bf22cbf2-a110-444e-952e-dca5dff670eb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:22.067079 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bf22cbf2-a110-444e-952e-dca5dff670eb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:22.129084 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bf22cbf2-a110-444e-952e-dca5dff670eb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:22.139072 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bf22cbf2-a110-444e-952e-dca5dff670eb tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1214 microversion: 2.1 time: 0.076657 Jun 17 07:21:22.139815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 109/210] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:22 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:22.710587 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:22.711231 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:22.719062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:22.719524 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:22.720316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:22.720748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:22.847327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:22.855880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6b9c1796-95a2-41c4-adf1-aedb5cdc196c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.149461 Jun 17 07:21:22.856635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 102/211] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:22 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:23.156334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:23.157093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:23.164761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:23.165550 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:23.166289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:23.166766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:23.240025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:23.248593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fef41ffa-3e1e-4e30-b4d7-45411adcc190 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1218 microversion: 2.1 time: 0.096048 Jun 17 07:21:23.249148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 110/212] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:23 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:23.873566 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:23.874178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:23.880702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:23.881151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:23.881916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:23.882355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:24.008787 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:24.016415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a984d88c-ed61-4551-81fc-3e1864865404 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.147225 Jun 17 07:21:24.017016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 103/213] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:23 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:24.265925 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:24.266485 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:24.268502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=68 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:24.274191 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:24.274641 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:24.275415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:24.275917 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:24.335494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:24.343367 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-833496bc-47f7-43ac-8c65-ee0c1b65a657 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1266 microversion: 2.1 time: 0.081276 Jun 17 07:21:24.344164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 111/214] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:24 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:25.033967 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:25.034571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:25.041581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:25.042021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:25.042773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:25.043204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:25.176238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:25.187415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ff9e95a3-f3c6-4c4c-9585-77218a74bc82 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.157310 Jun 17 07:21:25.188794 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 104/215] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:25 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:25.359920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:25.360566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:25.366651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:25.367097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:25.367853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:25.368310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:25.608397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:25.615849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-19dc65ae-c415-4f83-82ec-9e613189d6ed tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.259784 Jun 17 07:21:25.616772 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 112/216] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:25 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:25.922634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-49523121-4a27-42f3-92d7-b448277fbe88 req-10ff86b1-a354-4f3d-a9d0-8fc6e6d65434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717864ac-8dd6-45a9-ba32-23472cddbff6", "tag": "974663f9-1f26-4fde-97f5-e7f0391163b5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:25.939981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-49523121-4a27-42f3-92d7-b448277fbe88 req-10ff86b1-a354-4f3d-a9d0-8fc6e6d65434 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:25.940426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-49523121-4a27-42f3-92d7-b448277fbe88 req-10ff86b1-a354-4f3d-a9d0-8fc6e6d65434 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:25.955187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-49523121-4a27-42f3-92d7-b448277fbe88 req-10ff86b1-a354-4f3d-a9d0-8fc6e6d65434 service nova] Creating event network-changed:974663f9-1f26-4fde-97f5-e7f0391163b5 for instance 717864ac-8dd6-45a9-ba32-23472cddbff6 on hv-cinder-83482 Jun 17 07:21:25.961004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-49523121-4a27-42f3-92d7-b448277fbe88 req-10ff86b1-a354-4f3d-a9d0-8fc6e6d65434 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042218 Jun 17 07:21:25.961883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 105/217] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:26.207452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:26.208155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:26.217059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:26.218409 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:26.219394 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:26.220035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:26.433524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:26.441540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-53660b7f-63f0-48d4-b30a-84d1f7678f2d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.240211 Jun 17 07:21:26.442759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 113/218] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:26 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:26.634210 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:26.634893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:26.644492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:26.644732 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:26.645501 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:26.645942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:26.786335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:26.794602 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-14bc7a49-1a56-4682-8ace-4c2a6e5f13ff tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.165112 Jun 17 07:21:26.795156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 106/219] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:26 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:27.462557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:27.463666 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:27.472019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:27.472518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:27.473355 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:27.473860 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:27.761124 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:27.776893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b2b353a0-d32d-4a78-a4b2-79f805e7bb56 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.317875 Jun 17 07:21:27.786852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 114/220] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:27 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:27.810820 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:27.811429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:27.818556 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:27.819013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:27.819836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:27.820363 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:28.000416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:28.012158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-33a9402b-82b8-41b5-ad2a-6ceb6889a00d tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.204826 Jun 17 07:21:28.013154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 107/221] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:27 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:28.799041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:28.800107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:28.809577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:28.810165 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:28.811549 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:28.812133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:28.959488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:28.970429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-86a89bf8-388c-4c38-8e3b-9bd6da31813e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.179766 Jun 17 07:21:28.971330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 115/222] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:28 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:29.029701 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:29.030451 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:29.036985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:29.037709 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:29.038662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:29.038904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:29.182508 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:29.190353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ed9c0b26-15c2-4383-a202-224f0fc466da tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.164859 Jun 17 07:21:29.191003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 108/223] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:29 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:29.988586 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:29.989193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:30.003013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:30.003768 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:30.004982 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:30.005670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:30.142605 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:30.150411 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8f2d5933-8233-4728-8ebd-0d843cdcf934 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.166874 Jun 17 07:21:30.151213 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 116/224] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:29 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:30.207624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:30.208373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:30.215179 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:30.215631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:30.216419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:30.216887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:30.399244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:30.407649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b29f9883-6dac-426b-a9af-a45dcee43b8f tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.203664 Jun 17 07:21:30.408639 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 109/225] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:30 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:31.169875 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:31.170699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:31.177339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:31.178146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:31.178924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:31.179521 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:31.347939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:31.356811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bc1146ef-778c-4682-ac41-4ef5a9016080 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.192651 Jun 17 07:21:31.357929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 117/226] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:31 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:31.426706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:31.427325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:31.434498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:31.435244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:31.436250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:31.436888 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:31.587474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:31.595492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7225e1ce-f757-45b5-ab9d-242f85fbea4b tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.172804 Jun 17 07:21:31.596405 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 110/227] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:31 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:32.377328 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:32.382315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:32.385936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:32.402535 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:32.402999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:32.403799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:32.404276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:32.571414 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:32.579976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ea9bef33-31bf-4967-b032-b7cea4eaea6d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.209593 Jun 17 07:21:32.580862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 118/228] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:32 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:32.611826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-c17f7ac6-ab08-497e-8a88-825227ac36c5 req-04b9f4dc-6cda-4908-abde-eaf91fada2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717864ac-8dd6-45a9-ba32-23472cddbff6", "name": "network-vif-plugged", "status": "completed", "tag": "974663f9-1f26-4fde-97f5-e7f0391163b5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:32.614053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:32.614990 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:32.622483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:32.623296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:32.623983 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:32.625015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:32.625281 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:32.625787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:32.629178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-c17f7ac6-ab08-497e-8a88-825227ac36c5 req-04b9f4dc-6cda-4908-abde-eaf91fada2b1 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:32.630219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-c17f7ac6-ab08-497e-8a88-825227ac36c5 req-04b9f4dc-6cda-4908-abde-eaf91fada2b1 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:32.646012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-c17f7ac6-ab08-497e-8a88-825227ac36c5 req-04b9f4dc-6cda-4908-abde-eaf91fada2b1 service nova] Creating event network-vif-plugged:974663f9-1f26-4fde-97f5-e7f0391163b5 for instance 717864ac-8dd6-45a9-ba32-23472cddbff6 on hv-cinder-83482 Jun 17 07:21:32.651839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-c17f7ac6-ab08-497e-8a88-825227ac36c5 req-04b9f4dc-6cda-4908-abde-eaf91fada2b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043766 Jun 17 07:21:32.652996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 111/229] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:32.780492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:32.790224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-15313ae6-bd54-4103-857a-43e746f3e1ea tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.181637 Jun 17 07:21:32.790933 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 119/230] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:32 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:33.599034 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:33.599977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:33.607094 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.607537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.608335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.608763 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.801048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:33.807238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:33.807856 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:33.813919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.814660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.815650 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.816315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.822282 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-baf60110-f0d6-4ae9-8429-77c85f1b80b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1501 microversion: 2.1 time: 0.227584 Jun 17 07:21:33.824361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 112/231] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:33 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:33.843505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ec3dbab-fe8a-443c-8412-3c620abbbdc7"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:33.846230 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:33.852804 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.853252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.854164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.854872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.902044 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] HTTP exception thrown: Cannot 'attach_volume' instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc while it is in vm_state rescued Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Request method failure captured: Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/os-volume_attachments HTTP/1.1 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 74 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCscJCyreH5VH1x6U-gcUfpCNMF94Gukf8B1SqdB3M-TpmI9QAKJpH2k_r2ih9mvGlvgdtXO1R1G4fgffNI4JGTaFv1wfc5jyq8p9i1waO3Q1uXKHqJqqSM0zkbOk0yJxzo3kPqR3mD3MwjdS-G3hZKKiWyI1hoQqcDEisCjZKUWi1E Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:21:33.905200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: c11f44eb67cd4923a840171833bb572a Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {"volumeAttachment": {"volumeId": "4ec3dbab-fe8a-443c-8412-3c620abbbdc7"}} Jun 17 07:21:33.906398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Cannot 'attach_volume' instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc while it is in vm_state rescued Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'server_id': '5420c538-ebd6-4349-934d-9cd2d5ec2cfc', 'body': {'volumeAttachment': {'volumeId': '4ec3dbab-fe8a-443c-8412-3c620abbbdc7'}}} Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:21:33.907151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc while it is in vm_state rescued Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:33.908201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:33.909254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:21:33.909254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:21:33.909254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc while it is in vm_state rescued Jun 17 07:21:33.909254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:33.911275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Returning 409 to user: Cannot 'attach_volume' instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc while it is in vm_state rescued {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:21:33.912881 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-448a94ef-ec7e-47bc-9e74-976a6d6d0f12 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074425 Jun 17 07:21:33.917740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 113/232] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:21:33 2022] POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 07:21:33.925067 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:33.926059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:33.934152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.934782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.936398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:33.937665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:33.961803 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:33.973619 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:33.981507 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fe09cb4e-666a-4739-820a-e906e745c2d8 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1314 microversion: 2.1 time: 0.178507 Jun 17 07:21:33.982950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 120/233] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:33 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:34.016702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-176723a2-926d-49c5-8a2c-e76c89c68c8b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/action" status: 202 len: 0 microversion: 2.1 time: 0.097169 Jun 17 07:21:34.017547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 114/234] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:21:33 2022] POST /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:21:34.025589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:34.026106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:34.032804 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:34.033119 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:34.034022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:34.034441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:34.240804 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:34.256098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-95aef238-a2d0-4f20-8d5c-06a5e585478e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.233745 Jun 17 07:21:34.257315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 121/235] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:34 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:34.593193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-904535929", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:34.654314 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] validate_networks() for None {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:21:34.989944 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:21:34.990488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:21:34.991058 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:21:34.991641 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:21:34.992081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:21:34.999955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:35.001067 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:35.002480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.003152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.004116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.004568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.009882 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.010748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.011667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.012490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.023293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Getting quotas for project 72db86ca9d3a45b49c7bb140f6b0fa10. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:21:35.027831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Getting quotas for user dd94a883b0cb4dc4bcc57c221577b29a and project 72db86ca9d3a45b49c7bb140f6b0fa10. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:21:35.040022 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:21:35.043672 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:21:35.114703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a3caa3b8-24df-4caa-9a86-18686a011f1c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526383 Jun 17 07:21:35.115563 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 115/236] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:21:35.121293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:35.122124 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:35.130867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.131591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.132591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.133188 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.181639 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-836abe71-945f-4dff-b38c-95c01395c650 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/ips" status: 200 len: 143 microversion: 2.1 time: 0.064687 Jun 17 07:21:35.187771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 116/237] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:21:35 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/ips => generated 143 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:35.203959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3c419ce8-516f-445e-86f0-8d57a28f42cd tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:35.204635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3c419ce8-516f-445e-86f0-8d57a28f42cd tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:35.206719 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:35.210399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:35.219730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-77141298-d28a-4c7a-a75d-aaadbe6038fd tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1498 microversion: 2.1 time: 0.223690 Jun 17 07:21:35.220454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 122/238] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:34 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:35.275166 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:35.276728 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:35.288162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.288901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.290056 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:35.292846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:35.599776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:35.623820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e791649b-13fe-4cc3-ab17-8ecc5dfc8caa tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.353085 Jun 17 07:21:35.630037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 123/239] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:35 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:35.838148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3c419ce8-516f-445e-86f0-8d57a28f42cd tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:35.850055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3c419ce8-516f-445e-86f0-8d57a28f42cd tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1214 microversion: 2.1 time: 0.653996 Jun 17 07:21:35.850562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 117/240] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:35 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1214 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:36.021658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:36.023561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:36.032591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.033363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.034296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.035250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.075839 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:21:36.173379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-983287b8-146a-463f-979d-5d90127ed885 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "DELETE /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 204 len: 0 microversion: 2.1 time: 0.157098 Jun 17 07:21:36.173956 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 124/241] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:21:36 2022] DELETE /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:21:36.182475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:36.183314 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:36.189786 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.190504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.191509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.192199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.326158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:36.334447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fa426f73-1f60-483c-95a5-0855b0341ee5 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.155996 Jun 17 07:21:36.335173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 118/242] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:36 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:36.647001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:36.647715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:36.654376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.654823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.655571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.656363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.788907 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:36.797550 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ba52d72d-5936-44e2-a15b-67a4f9e1ccb5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.154625 Jun 17 07:21:36.798213 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 125/243] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:36 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:36.867666 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:36.868366 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:36.877372 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.877748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.878514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:36.878946 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:36.959190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:36.966695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c40a69c2-f79a-4a14-b584-93adea149877 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.103851 Jun 17 07:21:36.967334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 119/244] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:36 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:37.352287 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:37.352978 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:37.359497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.360027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:37.361017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.361506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:37.497484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:37.505216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-101f9f96-f4f1-4861-9050-ca37b6c74b72 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.156988 Jun 17 07:21:37.505791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 126/245] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:37 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:37.815634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:37.816281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:37.822392 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.823197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:37.823622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.824294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:37.959358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:37.967332 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-16344301-a1a6-463a-a598-19e399f7e972 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.155508 Jun 17 07:21:37.967903 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 120/246] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:37 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:37.984340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:37.985011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:37.991660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.992723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:37.992914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:37.993506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.058238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:38.065544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-50fb8172-7ba8-4316-b76c-1aa61f014154 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.085242 Jun 17 07:21:38.066104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 127/247] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:37 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:38.287206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:38.287960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:38.293850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.294298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.295043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.295479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.320085 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cef0c860-a590-49f5-b192-92d6dbc0d7a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/ips" status: 200 len: 151 microversion: 2.20 time: 0.036680 Jun 17 07:21:38.320662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 121/248] 10.222.0.33 () {60 vars in 1288 bytes} [Fri Jun 17 07:21:38 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:21:38.521473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:38.522058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:38.528610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.528990 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.530242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.530719 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.818695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:38.826361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-659911eb-86bf-4a77-b6e5-e732b48e52f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.308601 Jun 17 07:21:38.827122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 128/249] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:38 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:38.985577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:38.986343 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:38.993244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.993917 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:38.995415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:38.995931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:39.083353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:39.084336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:39.091059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:39.091600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:39.092617 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:39.093114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:39.134013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:39.141968 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2bb96be3-cb3a-4bff-b256-238dcc4089da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.160216 Jun 17 07:21:39.142626 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 122/250] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:38 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:39.161376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:39.169664 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-db58f433-66f9-4ba5-b86d-3c3776ea829a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.091231 Jun 17 07:21:39.170220 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 129/251] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:39 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:39.844367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:39.845220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:39.851173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:39.851613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:39.852382 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:39.853016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:39.983241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:39.991215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f73c5a89-b82f-45bb-b030-8dc5fd55b965 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.150730 Jun 17 07:21:39.991779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 123/252] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:39 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:40.158867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:40.159467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:40.165668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:40.166624 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:40.167377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:40.167807 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:40.186614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:40.187244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:40.193568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:40.194012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:40.194761 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:40.195192 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:40.261196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:40.268532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3a74a706-bfc9-4137-83b9-ff157c5ec0a6 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.085664 Jun 17 07:21:40.269087 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 124/253] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:40 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:40.298819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:40.306224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6f417021-8e14-4571-aab6-f9f6b89ff3e9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.151333 Jun 17 07:21:40.306855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 130/254] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:40 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:41.007854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:41.008484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:41.011498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:41.015429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.015869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.016656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.017088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.172496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:41.181019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f8619380-f0b7-47e7-99e2-87afd28867f1 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.176919 Jun 17 07:21:41.181877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 125/255] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:41 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:41.285039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:41.285644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:41.291931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.292462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.293214 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.293646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.323391 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:41.324012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:41.330710 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.331160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.331925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.332386 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.359095 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:41.366635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e35a884a-63fd-48f9-b12c-be7c71c0da99 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.085624 Jun 17 07:21:41.367205 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 131/256] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:41 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:41.464039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:41.471513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-97d3cce6-f2f1-4ecc-b9ea-322afd22fcb1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1509 microversion: 2.1 time: 0.152679 Jun 17 07:21:41.472085 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 126/257] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:41 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:41.626273 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6298009c-b280-4a18-ad23-e45d85334d29"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:41.627448 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:41.633396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.633833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.634575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.635022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.881977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:41.882448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:41.888496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.888945 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.889698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:41.890142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:41.911763 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lazy-loading 'flavor' on Instance uuid 029b110f-b393-4f26-a564-bc4c10ce744b {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:42.189035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c695f7bd-0185-460a-bbdc-78db14127ece tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/action" status: 202 len: 0 microversion: 2.20 time: 0.310894 Jun 17 07:21:42.190465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 127/258] 10.222.0.33 () {62 vars in 1318 bytes} [Fri Jun 17 07:21:41 2022] POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:21:42.198083 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:42.198787 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:42.205030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.205484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.206244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.206683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.339514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.348580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.350081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.351254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-93d900c4-1db0-4faf-ab42-84c94bef5e12 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.157271 Jun 17 07:21:42.351795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 128/259] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:42 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:21:42.356699 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:42.357298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:42.363158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.363583 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.364365 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.364796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.506513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.514897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c2fb5bfd-0f07-4ab4-bd55-f91d9f7366d9 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.162027 Jun 17 07:21:42.515657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 129/260] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:42 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:42.524183 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:42.524183 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:42.527537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.528046 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.528897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.529395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.548327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:42.596527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.603845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6af0c15a-c4bb-4795-b82f-8bb3d975b633 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.087101 Jun 17 07:21:42.604445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 130/261] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:42 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:42.608719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:42.609312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:42.615008 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.615452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.616242 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:42.616737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:42.739334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:42.747423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-dda9c5b1-c2ce-4fb4-9196-82b79e424b46 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1515 microversion: 2.1 time: 0.142048 Jun 17 07:21:42.747983 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 131/262] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:42 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1515 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:43.370248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:43.370860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:43.377334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.377789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.378548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.378985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.505756 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:43.514703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:43.516255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:43.517547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-eed3949a-66ab-43fb-8ae8-5fddfe6a1499 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.151193 Jun 17 07:21:43.518107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 132/263] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:43 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:21:43.532446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:43.533135 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:43.539359 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.539813 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.540601 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.541045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.665079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:43.672557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-56ecb115-d0fe-4002-bea5-58a344c46281 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.143678 Jun 17 07:21:43.673126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 133/264] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:43 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:43.677452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:43.678053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:43.684274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.684727 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.685482 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:43.685920 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:43.746334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:43.753642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e2f9bf27-e05b-4ac4-8658-666330dbab97 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.079581 Jun 17 07:21:43.754212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 134/265] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:43 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:44.536261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:44.536943 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:44.544226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.544675 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.545427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.545862 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.698155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:44.706111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:44.707675 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:44.708852 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3a3bf25b-9133-4d40-a894-830a451ac249 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.176494 Jun 17 07:21:44.709413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 135/266] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:44 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:21:44.714734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:44.715335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:44.721028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.721478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.722240 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.722678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.848906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:44.856427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7e8e2afa-38ee-4633-9808-a222cac422fc tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1504 microversion: 2.1 time: 0.146024 Jun 17 07:21:44.857031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 136/267] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:44 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:44.861637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:44.862294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:44.867938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.868424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.869190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:44.869628 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:44.931043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:44.941883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1f14a760-0eda-46c3-afd7-3a664dc0ee92 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1266 microversion: 2.1 time: 0.083152 Jun 17 07:21:44.942889 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 137/268] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:44 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:45.348470 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a83464ca-c88c-4a00-aa7a-fa74b0d79037 req-fcf672be-d9d6-4c04-b835-5cf0e3d85185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717864ac-8dd6-45a9-ba32-23472cddbff6", "name": "network-vif-deleted", "tag": "974663f9-1f26-4fde-97f5-e7f0391163b5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:45.352195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:45.359516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a83464ca-c88c-4a00-aa7a-fa74b0d79037 req-fcf672be-d9d6-4c04-b835-5cf0e3d85185 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.359958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a83464ca-c88c-4a00-aa7a-fa74b0d79037 req-fcf672be-d9d6-4c04-b835-5cf0e3d85185 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.371914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a83464ca-c88c-4a00-aa7a-fa74b0d79037 req-fcf672be-d9d6-4c04-b835-5cf0e3d85185 service nova] Creating event network-vif-deleted:974663f9-1f26-4fde-97f5-e7f0391163b5 for instance 717864ac-8dd6-45a9-ba32-23472cddbff6 on hv-cinder-83482 Jun 17 07:21:45.376953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a83464ca-c88c-4a00-aa7a-fa74b0d79037 req-fcf672be-d9d6-4c04-b835-5cf0e3d85185 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032190 Jun 17 07:21:45.377533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 138/269] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:21:45.723029 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-497843fd-c486-415b-b8dc-83b56692fa2f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.099018 Jun 17 07:21:45.727619 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 132/270] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:21:41 2022] POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments => generated 194 bytes in 4106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:45.730173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:45.731447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:45.746943 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.750091 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.751114 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.752475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.846852 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=8 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:45.875903 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:45.876688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:45.886384 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.886842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.887823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.888282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.927738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:45.928529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:45.930410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lazy-loading 'fault' on Instance uuid 717864ac-8dd6-45a9-ba32-23472cddbff6 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:45.979626 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:45.985339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:45.987032 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f3fea8c5-3114-48b7-9d2c-13563944e1ab tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1304 microversion: 2.1 time: 0.116370 Jun 17 07:21:45.995484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:45.997053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:45.997422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 133/271] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:45 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:45.998206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7b9bc3e7-bec0-4f65-ac5a-00493edaea8c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.273401 Jun 17 07:21:46.000533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 139/272] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:45 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:21:46.002263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:46.002901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:46.013353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:46.013887 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:46.014869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:46.015412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:46.077430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:46.085604 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5c25ba09-b96e-469b-b130-52676bab875d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1272 microversion: 2.1 time: 0.087010 Jun 17 07:21:46.086173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 134/273] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:45 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:46.177618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aded0b66-6fc0-43b4-9cdb-96f64d81c619 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: .version_select at 0x7f8b6d87dee0>, body: {"keypair": {"name": "tempest-keypair-2062397064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg7yfXiU8HvW7aOfPWuOXVItgMUMg3t7LGj3ws+88Nwn8r+MgNJgE04bzxAPu4mk5hFCGcEsR5Ph991hUNofxdwHsqKTC52RC7wQCxN/bs1pdVIvTkkR5orCTFjX7m6ag=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:46.195690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-aded0b66-6fc0-43b4-9cdb-96f64d81c619 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for project 2b581a57e3e44e3481b1db445961afc5. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:21:46.201042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-aded0b66-6fc0-43b4-9cdb-96f64d81c619 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for user c11f44eb67cd4923a840171833bb572a and project 2b581a57e3e44e3481b1db445961afc5. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:21:46.223466 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aded0b66-6fc0-43b4-9cdb-96f64d81c619 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049860 Jun 17 07:21:46.224080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 140/274] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:21:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:47.005718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:47.006333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:47.013199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.013648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.014412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.014840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.018006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:47.018865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:47.025905 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.026484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.027406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.027949 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.053463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.053929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.054389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lazy-loading 'fault' on Instance uuid 717864ac-8dd6-45a9-ba32-23472cddbff6 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:47.095555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:47.099329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:47.104867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7a945359-3eaa-4318-86a2-ac3ec3375560 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1304 microversion: 2.1 time: 0.104363 Jun 17 07:21:47.105450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 135/275] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:46 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:47.110364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:47.110970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:47.117409 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.117871 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.118622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:47.119116 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:47.181537 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:47.189443 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a3d89c90-e6a0-4d26-9fe9-24add66a014f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1272 microversion: 2.1 time: 0.083024 Jun 17 07:21:47.190010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 136/276] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:47 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:47.223921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:47.233292 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:47.235100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:47.236309 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e21eb3ae-fdf3-4fd5-904a-60e3aa586d9b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.224057 Jun 17 07:21:47.247436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 141/277] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:47 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:47.567796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1922336548", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60349c8e-a9e4-4c17-896b-25e895292e2e"}], "security_groups": [{"name": "tempest-securitygroup--746385697"}], "key_name": "tempest-keypair-2062397064", "user_data": "}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:47.677373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] validate_networks() for [('60349c8e-a9e4-4c17-896b-25e895292e2e', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:21:48.038346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:21:48.038916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:21:48.039278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:21:48.039683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:21:48.040115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:21:48.048831 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.049273 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.050055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.050483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.067188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:21:48.071422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Getting quotas for user c11f44eb67cd4923a840171833bb572a and project 2b581a57e3e44e3481b1db445961afc5. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:21:48.083070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:21:48.085330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:21:48.122212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:48.122819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:48.129325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.129770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.130525 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.130953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.131197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cbfa116e-611e-43c6-bde2-a0d3c61304e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.567528 Jun 17 07:21:48.131992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 137/278] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:21:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:21:48.142138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f8e3aeee-323d-42d4-b74b-4877452b6992 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:48.142748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f8e3aeee-323d-42d4-b74b-4877452b6992 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:48.163254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.163762 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.164237 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lazy-loading 'fault' on Instance uuid 717864ac-8dd6-45a9-ba32-23472cddbff6 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:21:48.207337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f8e3aeee-323d-42d4-b74b-4877452b6992 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.213023 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9710f6fb31da4df39b04839a29dfdb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '656ac358f6f44d7180b1122e87dc9c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.217458 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f8e3aeee-323d-42d4-b74b-4877452b6992 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1246 microversion: 2.1 time: 0.078955 Jun 17 07:21:48.218207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 138/279] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:48 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:48.222989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:48.223591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:48.229744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.230194 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.230708 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-71be0baa-0e3e-4a88-ae53-14aba3435a35 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 200 len: 1304 microversion: 2.1 time: 0.112786 Jun 17 07:21:48.230958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.231491 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 142/280] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:48 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:48.231615 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.256761 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:48.257763 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:48.267163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.267711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.268604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:48.269144 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:48.296915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.305194 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-70d0ce2f-963a-4813-b27f-0e2746304c68 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1272 microversion: 2.1 time: 0.085290 Jun 17 07:21:48.308111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 139/281] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:48 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:48.433302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.441166 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.442659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:48.443802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5bd4539d-7e95-4714-b97f-703ac8b4c563 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.192791 Jun 17 07:21:48.444698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 143/282] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:48 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:49.234809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:49.235478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:49.242581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.243066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.243946 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.244456 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.246918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:49.247533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] [instance: 717864ac-8dd6-45a9-ba32-23472cddbff6] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:49.255182 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.256010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.256818 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.257414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.271958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] HTTP exception thrown: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Request method failure captured: Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 HTTP/1.1 Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCtXNynrwsHFJHlDnU9H3BXS4Ix88L6ZAtz-kq5nfXkryPNw2dWh-ZCAZvR565egppRCSZHjYdmqJIA7bh4zNfIrVmtUUxleKtxazSkMFoIo0lyFciKv1CHlR15zwPU16qDpjtaO2eAH7f7GupbM2IsBFaOdIQ7uzIFcySsE7j9Qo8A Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 656ac358f6f44d7180b1122e87dc9c3e Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-VolumesActionsTest-988475808 Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:21:49.274038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/656ac358f6f44d7180b1122e87dc9c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-VolumesActionsTest-988475808 Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 656ac358f6f44d7180b1122e87dc9c3e Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-VolumesActionsTest-988475808 Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-VolumesActionsTest-988475808-project Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 9710f6fb31da4df39b04839a29dfdb34 Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-VolumesActionsTest-988475808-project Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. Jun 17 07:21:49.276111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '717864ac-8dd6-45a9-ba32-23472cddbff6'} Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:21:49.277011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. Jun 17 07:21:49.278295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:21:49.280178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] Returning 404 to user: Instance 717864ac-8dd6-45a9-ba32-23472cddbff6 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:21:49.280975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e349fe50-f024-40c9-bbf8-5ab3f5c02b15 tempest-VolumesActionsTest-988475808 tempest-VolumesActionsTest-988475808-project] 10.222.0.33 "GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6" status: 404 len: 111 microversion: 2.1 time: 0.038161 Jun 17 07:21:49.281534 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 144/283] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:49 2022] GET /compute/v2.1/servers/717864ac-8dd6-45a9-ba32-23472cddbff6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:21:49.318794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:49.325217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:49.326003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:49.328676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-06103978-ecb7-4c0a-8d11-9fed138e74c9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1298 microversion: 2.1 time: 0.097517 Jun 17 07:21:49.329889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 140/284] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:49 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:49.337496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.338710 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.339905 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.340579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.417481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:49.426565 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2a841573-2bed-44f7-980f-1503274f6212 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1272 microversion: 2.1 time: 0.106501 Jun 17 07:21:49.438919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 145/285] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:49 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:49.463658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:49.465158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:49.476398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.477006 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.477793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:49.478226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:49.918625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:49.934934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:49.939220 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:49.951179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-484a48b1-219e-4bb6-8948-31961bce9221 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.492543 Jun 17 07:21:49.954635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 141/286] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:49 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:50.347838 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:50.349084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:50.363025 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.363560 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:50.366771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.367297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:50.458706 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:50.460893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:50.486840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.493640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:50.498170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.499165 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:50.585255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:50.611742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fb5e9a74-4fa9-4d07-8d97-a9c0c020de61 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1304 microversion: 2.1 time: 0.267525 Jun 17 07:21:50.612704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 146/287] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:50 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:50.861808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:50.874257 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9fa8de4b-f8c8-4cf3-9f3f-a92d77b213b9 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.421606 Jun 17 07:21:50.875445 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 142/288] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:50 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:50.973307 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:50.974354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:50.982848 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.983488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:50.984596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:50.985475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:51.028103 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-3fd62aaa-c93e-4dea-96a7-5a169adb81d7 req-45671dc4-23d2-4bdb-b562-82b57f20cee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "746c133f-ca67-472b-ac28-d052fe3c2696", "tag": "3382a7dc-1ceb-4c5f-ac53-87ce508949ec"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:51.041256 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3fd62aaa-c93e-4dea-96a7-5a169adb81d7 req-45671dc4-23d2-4bdb-b562-82b57f20cee3 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:51.041691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3fd62aaa-c93e-4dea-96a7-5a169adb81d7 req-45671dc4-23d2-4bdb-b562-82b57f20cee3 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:51.061758 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-3fd62aaa-c93e-4dea-96a7-5a169adb81d7 req-45671dc4-23d2-4bdb-b562-82b57f20cee3 service nova] Creating event network-changed:3382a7dc-1ceb-4c5f-ac53-87ce508949ec for instance 746c133f-ca67-472b-ac28-d052fe3c2696 on hv-cinder-83482 Jun 17 07:21:51.067121 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-3fd62aaa-c93e-4dea-96a7-5a169adb81d7 req-45671dc4-23d2-4bdb-b562-82b57f20cee3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044406 Jun 17 07:21:51.068279 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 143/289] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:21:51.190883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:51.200699 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:51.202919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:51.204445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6d184ae0-4200-4270-8469-c37ef9d4fbc0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.234932 Jun 17 07:21:51.205529 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 147/290] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:50 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:51.630052 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:51.630764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:51.637468 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:51.637918 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:51.638677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:51.639112 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:51.764446 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:51.771738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5d40df73-a420-44d2-841b-6ef9fba2147d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.146336 Jun 17 07:21:51.772336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 144/291] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:51 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:51.891081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:51.891690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:51.898254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:51.898703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:51.899455 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:51.899890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:52.027061 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:52.034752 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8cc3a752-e4bc-477c-bb97-543db5ed57de tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.147535 Jun 17 07:21:52.035526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 148/292] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:51 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:52.223148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:52.223991 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:52.230410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:52.230861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:52.231614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:52.232045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:52.359556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:52.367322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:52.368852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:52.370590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b465c9f5-69db-4af6-9ac5-311d7e7d8c3f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.151320 Jun 17 07:21:52.371142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 145/293] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:52 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:52.788405 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:52.789009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:52.795749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:52.796223 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:52.796971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:52.797401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:52.801249 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:52.920286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:52.927629 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-427c076d-08db-41aa-8550-a4c979489113 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.143226 Jun 17 07:21:52.928155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 149/294] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:52 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:53.051367 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:53.051966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:53.058505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.058948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:53.059696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.060158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:53.187250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:53.194689 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e8c9c25c-0b9b-45f3-99e4-0809e596a4e8 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.147165 Jun 17 07:21:53.195249 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 146/295] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:53 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:53.389126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:53.389867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:53.396025 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.396526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:53.397284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.397722 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:53.553636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:53.562388 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:53.564019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:53.565337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c5ffde5c-8457-458e-8971-40f1f48d721e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.180726 Jun 17 07:21:53.566012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 150/296] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:53 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:53.944608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:53.945492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:53.948011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:53.954139 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.954589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:53.955350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:53.956478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.209717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-6c567a16-897c-4c5b-b6df-59c8844023c9 req-2ae52359-2bf9-4605-b529-039031ff1738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:54.228652 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6c567a16-897c-4c5b-b6df-59c8844023c9 req-2ae52359-2bf9-4605-b529-039031ff1738 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:54.229355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6c567a16-897c-4c5b-b6df-59c8844023c9 req-2ae52359-2bf9-4605-b529-039031ff1738 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.247846 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-6c567a16-897c-4c5b-b6df-59c8844023c9 req-2ae52359-2bf9-4605-b529-039031ff1738 service nova] Creating event network-changed:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:21:54.259074 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-6c567a16-897c-4c5b-b6df-59c8844023c9 req-2ae52359-2bf9-4605-b529-039031ff1738 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055536 Jun 17 07:21:54.260838 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 151/297] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:21:54.269038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:54.275086 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:54.283796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:54.284577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.285718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:54.286337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.452579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:54.460862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7365ab5f-e45d-4f14-b149-9626383f097d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.520153 Jun 17 07:21:54.461434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 147/298] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:53 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:54.550448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:54.558480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-19393366-6714-4dcb-b62a-7fbcb2efe3cc tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.296244 Jun 17 07:21:54.559040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 152/299] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:54 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:54.584038 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:54.584672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:54.590748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:54.591203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.591968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:54.592433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:54.716629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:54.724692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:54.726221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:54.727395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-237821e3-750a-4fc2-b38a-44d80744d94c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.147230 Jun 17 07:21:54.731800 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 148/300] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:54 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:21:55.478020 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:55.479273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:55.485779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.486404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.487362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.487792 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.584788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:55.584788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:55.594344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.595552 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.597909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.599922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.738029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:55.750493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b6911ca0-5ca9-439a-9f28-0e26bf04835b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.276163 Jun 17 07:21:55.751670 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 153/301] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:55 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:55.757039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:55.760421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:55.767318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.768047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.768921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:55.769402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:55.849010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:55.860944 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-727a13b5-dbec-43c8-8978-d2492659a46a tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.289213 Jun 17 07:21:55.862351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 149/302] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:55 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:55.921434 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:55.929931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:55.931707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:55.932896 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d1c9aec0-07f5-492b-ae92-f8fedabf3986 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.179836 Jun 17 07:21:55.943574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 154/303] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:55 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:56.778544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:56.779673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:56.794312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:56.795413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:56.797984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:56.802105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:56.889725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:56.891629 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:56.905017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:56.910356 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:56.911186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:56.913142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:56.914580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:56.997464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:57.006659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b38a58af-6c9a-41ee-bb4f-8ca221446ae3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.240951 Jun 17 07:21:57.008446 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 150/304] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:56 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:57.014151 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:57.015094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:57.021993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:57.022817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:57.023850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:57.024556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:57.180553 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:57.192155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4d857881-7106-4513-878d-d5aebad4131f tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.312539 Jun 17 07:21:57.193062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 155/305] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:56 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:57.208965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:57.221941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:57.224662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:57.226931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c4adb27c-193c-492b-876c-24c97f301745 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.217062 Jun 17 07:21:57.227835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 151/306] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:57 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:57.749749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d5609b39-b68c-4463-b87f-1a80ec674b50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:21:57.759310 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5609b39-b68c-4463-b87f-1a80ec674b50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:57.760819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d5609b39-b68c-4463-b87f-1a80ec674b50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:57.881640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d5609b39-b68c-4463-b87f-1a80ec674b50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Going to try to stop instance {{(pid=117395) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 07:21:57.943764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d5609b39-b68c-4463-b87f-1a80ec674b50 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action" status: 202 len: 0 microversion: 2.1 time: 0.202325 Jun 17 07:21:57.944715 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 156/307] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:21:57 2022] POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:21:57.954265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:57.955028 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:57.964202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:57.965567 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:57.966677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:57.967696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.027109 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:58.028399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:58.037241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.039090 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.042650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.043995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.058253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:58.215155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=8 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:58.241636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.252629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f3d7d6a6-f32e-4439-b181-2d158c3afc94 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.303930 Jun 17 07:21:58.266160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 152/308] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:57 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:58.271128 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:58.271747 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:58.282480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.283951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.285033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.319934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.634800 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.653568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-18406b24-46fb-427c-9b97-bb20a22d1c20 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.386199 Jun 17 07:21:58.655075 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 153/309] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:58 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:58.670451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:58.672951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:58.680653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.682268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.683466 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:58.684059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:58.762406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.777862 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-03bc8368-59ef-4075-9250-f2c8a0d0d874 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.755519 Jun 17 07:21:58.788800 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 157/310] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:58 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:21:58.945660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.949494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:21:58.955710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.957344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:58.965337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-84ee12ae-9160-447d-baae-c29134774d1d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.308699 Jun 17 07:21:58.975720 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 154/311] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:58 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:21:59.272768 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:59.273544 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:59.289936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.292120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.295769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.302812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.509062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:59.518575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e5a67fb9-e7b1-4b2b-b0b4-abddc9f86f07 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.249740 Jun 17 07:21:59.519166 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 158/312] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:59 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:59.674775 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:59.675681 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:59.691212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.691675 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.692500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.693211 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.795152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:59.796036 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:59.806600 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.808524 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.809541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.811516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:21:59.870725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:21:59.889850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-18aa5a83-43c0-4f2b-800b-aa19c72acdc3 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.217209 Jun 17 07:21:59.901529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 155/313] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:59 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:21:59.983579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:21:59.985044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:21:59.996286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:21:59.996978 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:00.000697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:00.001549 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:00.044356 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:00.053353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d693925a-1294-434a-87ee-2cb9ac3f5c3f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.262348 Jun 17 07:22:00.057836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 159/314] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:21:59 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:00.198019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:00.206986 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:00.208476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:00.209955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0db67626-9f52-445c-80f2-e85bd481bb53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.230523 Jun 17 07:22:00.210668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 156/315] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:21:59 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:00.536594 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:00.537905 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:00.547354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:00.548019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:00.549221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:00.549951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:00.781419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:00.792339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c0ed31a5-bcf1-4f17-bbce-346c02b91015 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.259937 Jun 17 07:22:00.792928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 160/316] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:00 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:00.906995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:00.907886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:00.933180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:00.933979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:00.939285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:00.940232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.047850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-36d4675f-7bf4-4647-97a6-b891ab07159e req-9434fb8a-b076-4178-bd6b-a531be92f066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746c133f-ca67-472b-ac28-d052fe3c2696", "name": "network-vif-plugged", "status": "completed", "tag": "3382a7dc-1ceb-4c5f-ac53-87ce508949ec"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:01.062024 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-36d4675f-7bf4-4647-97a6-b891ab07159e req-9434fb8a-b076-4178-bd6b-a531be92f066 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.063402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-36d4675f-7bf4-4647-97a6-b891ab07159e req-9434fb8a-b076-4178-bd6b-a531be92f066 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.078741 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-36d4675f-7bf4-4647-97a6-b891ab07159e req-9434fb8a-b076-4178-bd6b-a531be92f066 service nova] Creating event network-vif-plugged:3382a7dc-1ceb-4c5f-ac53-87ce508949ec for instance 746c133f-ca67-472b-ac28-d052fe3c2696 on hv-cinder-83482 Jun 17 07:22:01.103891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-36d4675f-7bf4-4647-97a6-b891ab07159e req-9434fb8a-b076-4178-bd6b-a531be92f066 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059156 Jun 17 07:22:01.106324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 161/317] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:01.124779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:01.126141 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:01.135373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.136228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.137244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.137926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.175901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:01.186939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-574252bf-2dda-419b-bfa4-da19b1cbe2ae tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.283652 Jun 17 07:22:01.190587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 157/318] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:00 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:01.228993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:01.230557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:01.243779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.246838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.248199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.257472 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.466040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:01.474668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c5bb1d10-5676-4ca9-9652-0df45c6eb80b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.366751 Jun 17 07:22:01.482339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 162/319] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:01 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:01.522992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:01.534517 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:01.538820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:01.539951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-10938c1b-e174-4ada-ad44-100a86e59428 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.315765 Jun 17 07:22:01.540593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 158/320] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:01 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:01.810638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:01.811253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:01.822501 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.825436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:01.826426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:01.828674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.024791 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.036415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aaec1d19-8308-4487-a90a-ca99e8016e7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.230827 Jun 17 07:22:02.037394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 163/321] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:01 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:02.205667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:02.206591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:02.216716 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.217483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.218332 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.218972 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.359193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.369938 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4edb0289-2dda-4b39-9874-971e030945e7 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.167004 Jun 17 07:22:02.370532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 159/322] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:02 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:02.493639 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:02.494755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:02.501785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.502300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.504477 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.505179 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.560299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:02.561345 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:02.569304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.570196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.571363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:02.572145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:02.770119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.779811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-01d53e15-c9c6-4da7-b6ad-a1fb8b7eef3d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.290069 Jun 17 07:22:02.780421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 164/323] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:02 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:02.795601 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.804114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.805622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:02.808280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2c53e91c-c5fb-4506-b55b-a71a553056c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.252388 Jun 17 07:22:02.808280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 160/324] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:02 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:03.054682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:03.055994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:03.063102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.063900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.064891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.065535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.128997 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-6323636f-58a1-4b25-851b-0efac25b1047 req-79ac249c-f90a-4881-9d02-ea327ae3e2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "name": "network-vif-plugged", "status": "completed", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:03.142110 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-6323636f-58a1-4b25-851b-0efac25b1047 req-79ac249c-f90a-4881-9d02-ea327ae3e2e9 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.143574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-6323636f-58a1-4b25-851b-0efac25b1047 req-79ac249c-f90a-4881-9d02-ea327ae3e2e9 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.161206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-6323636f-58a1-4b25-851b-0efac25b1047 req-79ac249c-f90a-4881-9d02-ea327ae3e2e9 service nova] Creating event network-vif-plugged:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:22:03.168688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-6323636f-58a1-4b25-851b-0efac25b1047 req-79ac249c-f90a-4881-9d02-ea327ae3e2e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043401 Jun 17 07:22:03.169958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 161/325] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:22:03.235843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:03.246602 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9b411600-66d2-4e7f-ab57-58b41355b829 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.195263 Jun 17 07:22:03.248936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 165/326] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:03 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:03.254102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-67643339", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "networks": [{"uuid": "d085d43f-8332-461f-be16-9921b6cc7d81"}]}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:03.316673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] validate_networks() for [('d085d43f-8332-461f-be16-9921b6cc7d81', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:22:03.390393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:03.391169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:03.409879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.413336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.414697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.416848 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.433315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:03.709902 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:03.720860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ef022d75-1b74-42d3-a785-64c96c366ce5 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1314 microversion: 2.1 time: 0.337547 Jun 17 07:22:03.722060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 166/327] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:03 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:03.737236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:22:03.737994 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:22:03.738533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:22:03.739003 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:22:03.739623 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:22:03.753266 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.753957 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.755003 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.755656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.773914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Getting quotas for project 71a5393056b74f1e871bb50775a40554. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:22:03.788701 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Getting quotas for user 7615cf807ce746ada15efa0ff1cb80d7 and project 71a5393056b74f1e871bb50775a40554. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:22:03.798578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:03.799595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:03.807677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.811133 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.812229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.814511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.829817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:22:03.833237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:22:03.898404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b1e626cb-d50d-470c-8a7c-06c77a0ec598 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648820 Jun 17 07:22:03.903674 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 162/328] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:22:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:22:03.908651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:03.909235 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:03.917608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.918356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:03.918851 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:03.919240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.057148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.065725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-41dade28-f8d9-4b14-b73b-929a19dbd841 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.270803 Jun 17 07:22:04.067411 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 167/329] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:03 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:04.073029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-53c733bb-3c4d-441d-951b-5c1489a0cded tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:04.073798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-53c733bb-3c4d-441d-951b-5c1489a0cded tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:04.081668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:04.139984 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-53c733bb-3c4d-441d-951b-5c1489a0cded tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.142326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.149844 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-53c733bb-3c4d-441d-951b-5c1489a0cded tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1217 microversion: 2.1 time: 0.081130 Jun 17 07:22:04.152631 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.160218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 168/330] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:04 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:04.163723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.166474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0efd705f-2857-4bb4-b236-cf6f6306eea1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.260281 Jun 17 07:22:04.167050 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 163/331] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:03 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:04.267260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:04.267863 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:04.275321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.275879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.276867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.277467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.461671 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.471294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-00db4c0f-6121-4b84-b498-41b31490d193 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.207428 Jun 17 07:22:04.472392 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 169/332] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:04 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:04.738124 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:04.738733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:04.745589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.746334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.747166 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.747677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.897365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:04.910224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-940d0156-e965-4a89-92a1-46257644c230 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1463 microversion: 2.1 time: 0.175797 Jun 17 07:22:04.911290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 164/333] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:04 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:04.953649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:04.954161 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:04.960810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.961358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.962199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:04.963273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:04.992419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:22:05.089271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:05.090234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:05.101352 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.102395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.103505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.104112 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.149434 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1e3996d2-3f7e-4011-9785-41f5a22e0999 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "DELETE /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 204 len: 0 microversion: 2.1 time: 0.199452 Jun 17 07:22:05.154090 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 170/334] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:22:04 2022] DELETE /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:22:05.161441 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:05.162063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:05.170330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.170892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.171998 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.172549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.277381 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.286685 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-16c88187-4dd8-4d50-8bbe-2993bb58b438 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.202511 Jun 17 07:22:05.292785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 165/335] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:05 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:05.303488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:05.304822 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:05.312974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.313456 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.315011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.315011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.351124 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.361702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4d0664a8-3586-4df2-99f6-2aa7748183d1 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1469 microversion: 2.1 time: 0.205626 Jun 17 07:22:05.370494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 171/336] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:05 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:05.375367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:05.375974 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:05.382254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.383373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.383709 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.384169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.384631 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.392863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3e107097-26f5-46eb-943c-d55fc41a2bb4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1269 microversion: 2.1 time: 0.098319 Jun 17 07:22:05.393455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 166/337] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:05 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:05.492916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:05.493638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:05.509496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.510064 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.510913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:05.511471 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:05.566627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.577440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.579128 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.580465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5cc1db97-fd98-47a8-8ebe-103495e2a44d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.208853 Jun 17 07:22:05.591570 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 172/338] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:05 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:05.663961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:05.673005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fd497d5c-da50-4ad5-8edc-5f83f6429f3e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.185803 Jun 17 07:22:05.674137 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 167/339] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:05 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:06.304397 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:06.305928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:06.313572 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.314251 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.315205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.315923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.389070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:06.389070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:06.405439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.405691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.407071 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.407800 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.480689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.488700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-03aa5217-47d6-4138-9391-5b02601a0b4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1371 microversion: 2.1 time: 0.188241 Jun 17 07:22:06.498419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 173/340] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:06 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:06.498419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:06.498419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:06.502170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.502742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.503911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.504176 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.574888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.580399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.583314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-aa796f71-fe6c-4a64-ace4-96c50aa79e21 tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1469 microversion: 2.1 time: 0.203478 Jun 17 07:22:06.584607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 168/341] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:06 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:06.594485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8b05cc26-7f8d-4a07-b5d1-9d9d3898f378 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1269 microversion: 2.1 time: 0.103842 Jun 17 07:22:06.598333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 174/342] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:06 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:06.601420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:06.602486 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:06.612637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.613087 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.613856 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.614298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.690562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:06.691169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:06.701147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.702289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.704603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:06.705053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:06.804763 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.814480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.816606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.817867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-70c2992c-3994-4a09-a5c5-7d8589595e5b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.222139 Jun 17 07:22:06.829737 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 169/343] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:06 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:06.917256 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:06.930842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-399dc0ce-8e04-4f13-8f28-130e8a9ddc8f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.244072 Jun 17 07:22:06.932374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 175/344] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:06 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:07.506362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:07.507731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:07.515290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.516091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.516853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.517297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.605893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:07.607379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:07.620286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.621719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.623977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.625393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.693327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:07.707659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4f89fa77-458a-43af-88a4-1934facd2ccd tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1564 microversion: 2.1 time: 0.205266 Jun 17 07:22:07.712636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 170/345] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:07.720439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:07.721465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:07.729228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.730058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.731080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.731755 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.811461 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:07.833123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:07.836657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b3272b1d-73f6-4133-b594-7b3c87d1dddb tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1269 microversion: 2.1 time: 0.122572 Jun 17 07:22:07.837557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 171/346] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1269 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:07.852102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-68c7b1ab-772a-453e-a951-4bbf03c4993c tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1469 microversion: 2.1 time: 0.252646 Jun 17 07:22:07.855111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:07.856028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 176/347] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:07.856420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:07.872413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:07.873390 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:07.874233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.874981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.876096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.876419 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.882410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.887143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.888963 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:07.889632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:07.998701 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-41b18032-d9d9-423d-8277-b4b6526dfa37 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154978 Jun 17 07:22:07.999909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 172/348] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:08.008307 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:08.009051 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:08.027789 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.028476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:08.030427 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.031037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:08.041500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:08.083523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:08.102318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:08.110019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:08.115098 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-50f73e3e-2fd5-40b6-b939-327c15dd8e25 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.256960 Jun 17 07:22:08.116197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 177/349] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:08.516531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:08.548623 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ca651b24-cb5a-42c9-8a2c-6984d8464cbf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.547375 Jun 17 07:22:08.558555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 173/350] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:07 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:08.856095 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:08.857514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:08.873240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:08.873850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:08.878702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.887040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:08.888042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.888681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:08.897945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.898667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:08.899602 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:08.900258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:09.101171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:09.111774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9e907fa1-e172-42fb-8c37-9dcd30e166f6 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1275 microversion: 2.1 time: 0.260683 Jun 17 07:22:09.112941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 178/351] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:08 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:09.119567 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-813a31e5-c077-452d-b79d-2b2efd1cab64 req-40fff70a-356d-4e9c-a129-ef2eaaf43d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "746c133f-ca67-472b-ac28-d052fe3c2696", "name": "network-vif-deleted", "tag": "3382a7dc-1ceb-4c5f-ac53-87ce508949ec"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:09.129096 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-813a31e5-c077-452d-b79d-2b2efd1cab64 req-40fff70a-356d-4e9c-a129-ef2eaaf43d7a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:09.129604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-813a31e5-c077-452d-b79d-2b2efd1cab64 req-40fff70a-356d-4e9c-a129-ef2eaaf43d7a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:09.155986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-813a31e5-c077-452d-b79d-2b2efd1cab64 req-40fff70a-356d-4e9c-a129-ef2eaaf43d7a service nova] Creating event network-vif-deleted:3382a7dc-1ceb-4c5f-ac53-87ce508949ec for instance 746c133f-ca67-472b-ac28-d052fe3c2696 on hv-cinder-83482 Jun 17 07:22:09.161289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-813a31e5-c077-452d-b79d-2b2efd1cab64 req-40fff70a-356d-4e9c-a129-ef2eaaf43d7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046917 Jun 17 07:22:09.162523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 179/352] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:09.169344 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:09.170481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:09.190929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:09.191698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:09.192658 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:09.194015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:09.312928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd94a883b0cb4dc4bcc57c221577b29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72db86ca9d3a45b49c7bb140f6b0fa10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:09.322797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c30d5fc6-9808-49e7-ad41-da066f85c96d tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 200 len: 1427 microversion: 2.1 time: 0.454067 Jun 17 07:22:09.334228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 174/353] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:08 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 1427 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:09.379001 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:09.390423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:09.392286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:09.395590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f1b60267-97ef-45c6-ab7e-e8dff131ecfb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1745 microversion: 2.20 time: 0.231556 Jun 17 07:22:09.397515 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 180/354] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:09 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:09.575262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:09.576571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:09.585545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:09.586167 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:09.587059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:09.588241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.029108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:10.038935 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a7ace420-bd6a-4304-860e-d246a4660432 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.467460 Jun 17 07:22:10.050339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 175/355] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:09 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:10.129607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:10.132799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:10.143596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.144370 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.146338 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.146939 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.228403 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:10.237655 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-51a37389-18c9-494a-8be4-e10e125946d4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1275 microversion: 2.1 time: 0.111766 Jun 17 07:22:10.247048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 181/356] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:10 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:10.342848 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:10.343505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] [instance: 746c133f-ca67-472b-ac28-d052fe3c2696] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:10.361750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.362229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.363059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.366523 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.400705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] HTTP exception thrown: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Request method failure captured: Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 HTTP/1.1 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCt89O_WhC36WGB06h-54trj-os2qVddOZ0noRPljlWKUC5eh4uwvQ-d3mCUZARDSCn9l3c7iuguIaZAJqO2TegqOTq1GuN5gEvHAfZcv2_XkOe4UVckRDR2i-KZDmHdxbwPGgvLd-QCs7Xwjp14iWA9o57dM9766UCJsW7TXfIDab0 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 72db86ca9d3a45b49c7bb140f6b0fa10 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesNegativeTest-1102731280 Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:22:10.405284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72db86ca9d3a45b49c7bb140f6b0fa10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72db86ca9d3a45b49c7bb140f6b0fa10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72db86ca9d3a45b49c7bb140f6b0fa10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72db86ca9d3a45b49c7bb140f6b0fa10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesNegativeTest-1102731280 Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 72db86ca9d3a45b49c7bb140f6b0fa10 Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesNegativeTest-1102731280 Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesNegativeTest-1102731280-project Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: dd94a883b0cb4dc4bcc57c221577b29a Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesNegativeTest-1102731280-project Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. Jun 17 07:22:10.406632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '746c133f-ca67-472b-ac28-d052fe3c2696'} Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:22:10.407420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. Jun 17 07:22:10.411343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:22:10.412509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] Returning 404 to user: Instance 746c133f-ca67-472b-ac28-d052fe3c2696 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:22:10.412509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ddc48652-32b0-4010-a9e0-902ae05c3f0e tempest-VolumesNegativeTest-1102731280 tempest-VolumesNegativeTest-1102731280-project] 10.222.0.33 "GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696" status: 404 len: 111 microversion: 2.1 time: 0.070804 Jun 17 07:22:10.412509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 176/357] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:10 2022] GET /compute/v2.1/servers/746c133f-ca67-472b-ac28-d052fe3c2696 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:22:10.421109 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:10.421599 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:10.431995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.432532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.438108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-c8e1f8bd-2e35-4e99-8dbe-04cebdd096f5 req-36121bcd-eae8-47e7-9396-e85cd35a1532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:10.439269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.448105 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.466759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-c8e1f8bd-2e35-4e99-8dbe-04cebdd096f5 req-36121bcd-eae8-47e7-9396-e85cd35a1532 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:10.467210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-c8e1f8bd-2e35-4e99-8dbe-04cebdd096f5 req-36121bcd-eae8-47e7-9396-e85cd35a1532 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:10.479903 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-c8e1f8bd-2e35-4e99-8dbe-04cebdd096f5 req-36121bcd-eae8-47e7-9396-e85cd35a1532 service nova] Creating event network-changed:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:22:10.489256 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-c8e1f8bd-2e35-4e99-8dbe-04cebdd096f5 req-36121bcd-eae8-47e7-9396-e85cd35a1532 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054520 Jun 17 07:22:10.490640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 177/358] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:22:10.769957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:10.773490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:10.784187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:10.791063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:10.792656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-29d78f47-caf2-49f1-8841-207c34918dda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1745 microversion: 2.20 time: 0.375568 Jun 17 07:22:10.799212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 182/359] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:10 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1745 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:11.065928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:11.067639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:11.079665 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.080537 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.081695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.082368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.258511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:11.259384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:11.277423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.279211 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.281144 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.283154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.737127 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:11.750650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ab5743cd-8959-434c-a3fc-19f4c4e8fc04 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.500194 Jun 17 07:22:11.751388 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 183/360] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:11 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:11.817790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:11.818679 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:11.834911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.837563 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.838792 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:11.839281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:11.846338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:11.862428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e7b9e535-46b6-4637-beae-debc17032955 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.806652 Jun 17 07:22:11.864696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 178/361] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:11 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:12.026205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:12.039298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:12.042106 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:12.043554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ff0184f8-e7d5-41ce-aeea-082df983cec8 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.230764 Jun 17 07:22:12.044499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 184/362] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:11 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:12.517570 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-2023b38b-a2de-4066-afcc-a3f058595355 req-096f18b9-fdf8-4cc4-be8c-a3365fc30f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1", "tag": "1dfb0adf-408e-4ceb-92dc-92eadc56d5e4"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:12.528659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2023b38b-a2de-4066-afcc-a3f058595355 req-096f18b9-fdf8-4cc4-be8c-a3365fc30f0f service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:12.529447 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2023b38b-a2de-4066-afcc-a3f058595355 req-096f18b9-fdf8-4cc4-be8c-a3365fc30f0f service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:12.562562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-2023b38b-a2de-4066-afcc-a3f058595355 req-096f18b9-fdf8-4cc4-be8c-a3365fc30f0f service nova] Creating event network-changed:1dfb0adf-408e-4ceb-92dc-92eadc56d5e4 for instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 on hv-cinder-83482 Jun 17 07:22:12.568428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-2023b38b-a2de-4066-afcc-a3f058595355 req-096f18b9-fdf8-4cc4-be8c-a3365fc30f0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054235 Jun 17 07:22:12.569547 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 179/363] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:12.769893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:12.770584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:12.781575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:12.782035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:12.786066 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:12.786534 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:12.883814 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:12.884555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:12.901346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:12.902146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:12.902983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:12.903428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:13.055166 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:13.070158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1e16c7c6-cdd4-46f3-8977-f5f2c53dcb4f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.305890 Jun 17 07:22:13.076143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 185/364] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:12 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:13.081215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:13.088260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:13.096584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:13.097205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:13.098174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:13.098773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:13.207160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:13.222958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-68c0c9a1-3a7f-452f-b2d5-f44702189419 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.344270 Jun 17 07:22:13.224339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 180/365] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:12 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:13.248892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-1f07fc80-49de-468d-b44e-11d13c876415 req-1f43e32e-1d71-4aa5-bcdd-4efc1112aba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "name": "network-vif-plugged", "status": "completed", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:13.276960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1f07fc80-49de-468d-b44e-11d13c876415 req-1f43e32e-1d71-4aa5-bcdd-4efc1112aba5 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:13.277448 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1f07fc80-49de-468d-b44e-11d13c876415 req-1f43e32e-1d71-4aa5-bcdd-4efc1112aba5 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:13.323589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-1f07fc80-49de-468d-b44e-11d13c876415 req-1f43e32e-1d71-4aa5-bcdd-4efc1112aba5 service nova] Creating event network-vif-plugged:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:22:13.335904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-1f07fc80-49de-468d-b44e-11d13c876415 req-1f43e32e-1d71-4aa5-bcdd-4efc1112aba5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109172 Jun 17 07:22:13.339292 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 181/366] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:13.376127 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:13.401836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:13.401836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:13.401836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5c7102ba-e610-4b1f-8ac1-99adc1132600 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.319208 Jun 17 07:22:13.402733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 186/367] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:13 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:14.090981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:14.092239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:14.096048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:14.097071 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:14.102763 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.103880 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.104940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.105589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.244391 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:14.245033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:14.258205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:14.263753 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.264246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.265069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.265513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.593055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:14.601353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:14.612937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7cd3f13a-1eb7-4f10-9c1c-f42c9c331b7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.376156 Jun 17 07:22:14.613713 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 187/368] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:14 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:14.615875 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-735ad72e-0490-4796-b7a0-9b99c81f14c9 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.526850 Jun 17 07:22:14.625259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 182/369] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:14 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:14.629635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:14.630129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:14.639571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.639859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.640730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:14.641136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:14.814480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:14.833415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:14.836024 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:14.837283 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-17acb787-2c5f-4421-b846-64b9fd131ebc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.217215 Jun 17 07:22:14.838248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 188/370] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:14 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:15.630557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:15.631162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:15.638015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:15.640414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:15.642035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.643791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.644755 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.645332 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.652291 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.653003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.655294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.655986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.824658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:15.835233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-12a98202-fc6a-40cc-828b-2dbf52c66ee0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.208476 Jun 17 07:22:15.863242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 183/371] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:15 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:15.872023 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:15.873561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:15.879071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:15.894170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ce16a9fc-7aa6-4adb-98bd-e477b05f277d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.262058 Jun 17 07:22:15.895202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.895871 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.897753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:15.901287 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:15.904355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 189/372] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:15 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:16.138503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:16.153088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:16.154698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:16.155956 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-12fab3c3-c992-41df-8be1-e40fd0281ee4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.290771 Jun 17 07:22:16.157082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 184/373] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:15 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:16.855178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:16.856125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:16.870377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:16.871116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:16.872439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:16.873028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:16.911643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:16.912348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:16.924026 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:16.924498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:16.927049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:16.927652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:17.133634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:17.145925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-83ca5b93-f4c3-41d6-9a66-7bdbfaf7f5a6 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.295309 Jun 17 07:22:17.146934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 190/374] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:16 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:17.175987 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:17.176361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:17.186199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:17.187393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:17.189268 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:17.189879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:17.262755 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:17.271935 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a4cd77c0-08c9-45e1-8bf1-d966364da93d tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.365233 Jun 17 07:22:17.273390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 185/375] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:16 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:17.392537 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:17.402322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:17.404101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:17.405789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-048197ce-e841-48a5-8654-0eaf186851aa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.234850 Jun 17 07:22:17.406687 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 191/376] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:17 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:18.162973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:18.163834 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:18.176902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.177354 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.178126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.178555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.290286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:18.291445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:18.305110 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.305844 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.306814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.307402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.511498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:18.526258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b50a475e-68a7-46b1-883c-3ae03c4b083b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1721 microversion: 2.1 time: 0.366064 Jun 17 07:22:18.528540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 186/377] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:18 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:18.537782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:18.540195 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:18.552992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.553842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.555168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:18.557616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:18.588717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:18.597818 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-52f9fc8f-fba5-4d3d-87c1-a3cdfc5efc94 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.311499 Jun 17 07:22:18.607523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 192/378] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:18 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:18.801083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:18.811036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:18.813282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:18.814947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ea397c5e-3cc3-488e-8a9c-045bd86f145e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.282928 Jun 17 07:22:18.815966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 187/379] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:18 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:19.188591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-9ae9c153-150b-4bc7-85ff-85c0ede8c05b req-4497e0a5-7fa2-484a-9b5d-d3172343c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1", "name": "network-vif-plugged", "status": "completed", "tag": "1dfb0adf-408e-4ceb-92dc-92eadc56d5e4"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:19.201273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9ae9c153-150b-4bc7-85ff-85c0ede8c05b req-4497e0a5-7fa2-484a-9b5d-d3172343c1dc service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.202794 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9ae9c153-150b-4bc7-85ff-85c0ede8c05b req-4497e0a5-7fa2-484a-9b5d-d3172343c1dc service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.227016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-9ae9c153-150b-4bc7-85ff-85c0ede8c05b req-4497e0a5-7fa2-484a-9b5d-d3172343c1dc service nova] Creating event network-vif-plugged:1dfb0adf-408e-4ceb-92dc-92eadc56d5e4 for instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 on hv-cinder-83482 Jun 17 07:22:19.248280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-9ae9c153-150b-4bc7-85ff-85c0ede8c05b req-4497e0a5-7fa2-484a-9b5d-d3172343c1dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054727 Jun 17 07:22:19.249541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 193/380] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:19.546374 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:19.549014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:19.579137 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.579723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.586021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.586482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.617533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:19.618971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:19.637953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.638660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.639634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.640100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.910164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:19.911001 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:19.942423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0ca2c27a-5251-47dc-b28d-b65dab2fdcf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1698 microversion: 2.1 time: 0.400856 Jun 17 07:22:19.948218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5762bc22-eb6b-4f89-b039-570dcc021935 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.334823 Jun 17 07:22:19.948721 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 188/381] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:19 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1698 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:19.955649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 194/382] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:19 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:19.967232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:19.968347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:19.978647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.987273 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:19.989668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:19.995443 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:20.006618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-48453656-ac97-42f5-8264-4df69be0bca1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:20.033116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48453656-ac97-42f5-8264-4df69be0bca1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:20.034222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-48453656-ac97-42f5-8264-4df69be0bca1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:20.114082 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-48453656-ac97-42f5-8264-4df69be0bca1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Going to try to start instance {{(pid=117395) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 07:22:20.219411 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-48453656-ac97-42f5-8264-4df69be0bca1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action" status: 202 len: 0 microversion: 2.1 time: 0.223884 Jun 17 07:22:20.220316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 195/383] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:22:19 2022] POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:22:20.234561 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:20.235141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:20.235308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:20.246520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:20.249081 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:20.250709 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cb321ada-bd91-4ac3-91b5-cda432bd1913 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.300493 Jun 17 07:22:20.252050 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 189/384] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:19 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:20.254270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:20.263128 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:20.264720 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:20.265455 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:20.556721 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:20.570312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-74a2465e-4c24-45f1-8ea0-a75283166324 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1707 microversion: 2.1 time: 0.345845 Jun 17 07:22:20.571599 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 196/385] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:20 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1707 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:20.977168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:20.977807 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:20.980160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:20.987870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:20.988374 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:20.989296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:20.989732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:21.168879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:21.181581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6da30ccf-1fe7-4e7e-aeb5-e87dd529811b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1317 microversion: 2.1 time: 0.207576 Jun 17 07:22:21.191672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 190/386] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:20 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:21.269659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:21.270317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:21.286999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:21.288700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:21.293072 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:21.293789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:21.588305 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:21.589225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:21.597955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:21.598779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:21.599980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:21.600679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:21.681584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:21.694656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:21.699711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:21.703204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5a3f496b-16db-4f9a-b1cc-67719f9a8705 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.437723 Jun 17 07:22:21.704585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 197/387] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:21 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:21.923257 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:21.932483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b196ff6f-4761-452b-8cbb-f687969a4649 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1707 microversion: 2.1 time: 0.348097 Jun 17 07:22:21.943656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 191/388] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:21 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1707 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:22.208937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:22.223345 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:22.239423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.240570 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.244188 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.244653 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.563215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:22.575340 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-172a21ae-9de7-4eab-8d14-5dda88ad1223 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1506 microversion: 2.1 time: 0.373505 Jun 17 07:22:22.588971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 198/389] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:22 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:22.729929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:22.731170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:22.741379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.742267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.743953 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.744679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.773298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:22.951453 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:22.952389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:22.966722 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.967687 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.969506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:22.970100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:22.983650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:23.049966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:23.077940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:23.086651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:23.092263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-dedbc37f-e54f-4e87-8c49-d323f3440f20 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.371943 Jun 17 07:22:23.094606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 192/390] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:22 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:23.555842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:23.565361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c7798477-47f7-492a-b06c-01486bfd3031 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1707 microversion: 2.1 time: 0.617709 Jun 17 07:22:23.580445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 199/391] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:22 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1707 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:24.124833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:24.125660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:24.174097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:24.174989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:24.176327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:24.177070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:24.582384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:24.583316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:24.590741 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:24.593662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:24.601635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:24.602332 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:24.816339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:24.826199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:24.834264 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:24.842904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f3a62876-a6e7-4322-b869-bec71a8a8d93 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.722376 Jun 17 07:22:24.844083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 193/392] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:24 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:24.976668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:25.003717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-80143ec3-7d38-4595-b281-b57d6507f22d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1711 microversion: 2.1 time: 0.424765 Jun 17 07:22:25.019413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:24 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1711 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:25.866277 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:25.868295 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:25.885506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:25.886327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:25.890738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:25.891594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:26.308284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:26.319637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:26.325718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:26.327260 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5ad3df38-cb21-4d5e-b0b0-7ce56029fb50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.469428 Jun 17 07:22:26.329047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 194/394] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:25 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:27.348831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:27.349443 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:27.367719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:27.368280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:27.370359 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:27.372941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:28.018781 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:28.033798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:28.036928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:28.041554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3cebc358-665c-461e-8df9-681fc841671e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1740 microversion: 2.20 time: 0.698544 Jun 17 07:22:28.043395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 201/395] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:27 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1740 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:29.062940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:29.064232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:29.076903 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:29.077543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:29.096591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:29.097601 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:29.309784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:29.325325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:29.328400 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:29.329787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-57976847-f367-45a7-9e83-70d9ae4c78e6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1722 microversion: 2.20 time: 0.270519 Jun 17 07:22:29.347331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 195/396] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:29 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:30.349392 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:30.352531 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:30.364876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:30.365354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:30.366032 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:30.366673 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:30.609385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:30.619097 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:30.620946 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:30.622370 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8be1cbed-4b99-4cc6-bff1-553c659660b4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1722 microversion: 2.20 time: 0.277695 Jun 17 07:22:30.623142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 202/397] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:30 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:31.639837 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:31.641043 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:31.649018 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:31.650226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:31.651172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:31.651755 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:31.844785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:31.854959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:31.856839 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:31.858715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6fe893fb-1bdd-4a2c-a7cb-1855bc878792 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1665 microversion: 2.20 time: 0.222520 Jun 17 07:22:31.860029 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 196/398] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:31 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1665 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:31.876471 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a45987-a7c8-44d7-826e-0cdd55be5869"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:31.877621 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:31.895966 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:31.896341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:31.897129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:31.897577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:32.394514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-12c9e68c-2cd2-44ea-8245-807fd8413ded tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.519550 Jun 17 07:22:32.397143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 203/399] 10.222.0.33 () {62 vars in 1363 bytes} [Fri Jun 17 07:22:31 2022] POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments => generated 188 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:22:32.675813 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:32.677259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:32.684786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:32.685581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:32.687498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:32.688253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:32.832408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-23bf6c3f-3667-4737-a84b-df28f9cc5337 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/action" status: 202 len: 0 microversion: 2.20 time: 0.160748 Jun 17 07:22:32.846070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:32.846984 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:32.852384 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 197/400] 10.222.0.33 () {62 vars in 1318 bytes} [Fri Jun 17 07:22:32 2022] POST /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:22:32.863356 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:32.864292 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:32.869045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:32.869884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:33.188871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:33.201833 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:33.205346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:33.208489 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d4cc98d3-709f-4bff-b3aa-b1306b5cc20d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1751 microversion: 2.20 time: 0.366948 Jun 17 07:22:33.209521 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 204/401] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:32 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1751 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:34.138670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-1a38101f-ccaa-47d6-a040-c5af2bd755f8 req-a4139e8b-1116-48aa-871c-d6c64dbfe1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "name": "network-vif-unplugged", "status": "completed", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:34.152470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1a38101f-ccaa-47d6-a040-c5af2bd755f8 req-a4139e8b-1116-48aa-871c-d6c64dbfe1a8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:34.156031 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1a38101f-ccaa-47d6-a040-c5af2bd755f8 req-a4139e8b-1116-48aa-871c-d6c64dbfe1a8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:34.203335 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.compute.server_external_events [req-1a38101f-ccaa-47d6-a040-c5af2bd755f8 req-a4139e8b-1116-48aa-871c-d6c64dbfe1a8 service nova] Unable to find a host for instance 029b110f-b393-4f26-a564-bc4c10ce744b. Dropping event network-vif-unplugged {{(pid=117396) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 07:22:34.211410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-1a38101f-ccaa-47d6-a040-c5af2bd755f8 req-a4139e8b-1116-48aa-871c-d6c64dbfe1a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077908 Jun 17 07:22:34.213594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 198/402] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 07:22:34.231180 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:34.231942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:34.239209 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:34.240949 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:34.246704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:34.252323 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:34.253163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:34.610437 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:34.623142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:34.625618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:34.628484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cd8e2150-4b96-4b02-84c9-3cbff89660fe tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1751 microversion: 2.20 time: 0.401508 Jun 17 07:22:34.632170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 205/403] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:34 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1751 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:35.650788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:35.651412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:35.677474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:35.679574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:35.680921 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:35.683727 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:35.951407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:35.979118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:35.981878 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:35.984552 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-34b4a6bf-aa79-4989-baea-74e2928917a7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1753 microversion: 2.20 time: 0.337837 Jun 17 07:22:35.985516 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 199/404] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:35 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1753 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:37.008571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:37.009280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:37.019670 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:37.020142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:37.023706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:37.028776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:37.323272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:37.338238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:37.339753 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:37.340955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3dd65457-a8b5-4668-a346-0d1d46d3f407 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.338960 Jun 17 07:22:37.360178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 206/405] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:36 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:38.384848 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:38.385523 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:38.411494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:38.411947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:38.412768 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:38.413199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:39.411338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:39.438912 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:39.449928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:39.451238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e9d9f6fc-c757-45e4-864a-8f261b4f83fc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 1.071301 Jun 17 07:22:39.451817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 200/406] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:38 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:39.963004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49fd7109-0cb6-4d77-bec4-3cc57a6d95dc", "device": "/dev/sdb"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:39.972056 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:40.018218 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:40.018674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:40.030075 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:40.030742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:40.469145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:40.470360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:40.483711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:40.484417 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:40.485346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:40.485927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:40.667429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f4e95f1a-0beb-4abd-99a4-7cdefa57f611 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "POST /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709669 Jun 17 07:22:40.686988 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 207/407] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:22:39 2022] POST /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:41.135877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:41.157976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:41.165312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:41.167384 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-07c2aef7-caab-4d93-8c3e-a7882c366ee1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.701940 Jun 17 07:22:41.168424 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 201/408] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:40 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:41.795265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3a5d75ec-dcc4-4f09-8091-94c940ee15a3 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Action: 'create', calling method: .version_select at 0x7f8b6d57eca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-578391782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHhvog6ASXWkQurRAeGa+fWGgLEMVPo3dl1MoC6CAqcuOvWiiLlwm5lXJPFLejFaZRfR/YlzmR0DJ/HXGv//ojRoRsJYMkeL5EyURr6mUa02ksSoldzs6/+Rg/1a9NClw=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:41.868469 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-3a5d75ec-dcc4-4f09-8091-94c940ee15a3 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Getting quotas for project f92a857cef0a43d4907fbc667e30df6d. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:22:41.894294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-3a5d75ec-dcc4-4f09-8091-94c940ee15a3 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Getting quotas for user 86f2cda914b74f979746f4fb370eaae6 and project f92a857cef0a43d4907fbc667e30df6d. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:22:41.974328 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3a5d75ec-dcc4-4f09-8091-94c940ee15a3 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.513536 Jun 17 07:22:41.981610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 208/409] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:22:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:42.191676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:42.192483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:42.215430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:42.218711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:42.221372 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:42.223898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:42.713311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:42.724193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:42.725901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:42.727451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-63a6abb5-5b91-4a4a-9725-1c2bd1f697d2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.544283 Jun 17 07:22:42.729173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 202/410] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:42 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:43.748220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:43.750226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:43.772044 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:43.773071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:43.774155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:43.775479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:44.351611 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:44.363129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:44.364871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:44.368473 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-21b94206-23dc-4269-8c5f-529515596397 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.625658 Jun 17 07:22:44.374204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 209/411] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:43 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:45.389694 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:45.391144 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:45.409938 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:45.410696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:45.411828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:45.414783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:45.753653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:45.762775 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:45.766523 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:45.768015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a1fb2864-0ca0-4fa0-9dad-ab2382d1446f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.382645 Jun 17 07:22:45.782956 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 203/412] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:45 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:46.790564 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:46.791820 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:46.798459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:46.804755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:46.806151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:46.806613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:47.141509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:47.157528 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:47.159265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:47.168186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-045a8950-821e-467b-ba57-3e9070fb0dc7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.381076 Jun 17 07:22:47.170459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 210/413] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:46 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:48.188270 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:48.188882 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:48.198792 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:48.206127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:48.206983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:48.207413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:48.694937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:48.706582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:48.710247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:48.711752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bbff78b7-27c9-4072-be10-e35321521dd6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.527385 Jun 17 07:22:48.712917 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 204/414] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:48 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:49.730830 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:49.731483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:49.738839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:49.739296 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:49.740112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:49.748924 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:50.067752 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:50.118417 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:50.134629 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:50.136111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-89325ffb-68d1-4bb8-a98a-33bd2701ab14 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.409739 Jun 17 07:22:50.146549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 211/415] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:49 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:51.155735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:51.157094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:51.167362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=32 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:51.181658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:51.190263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:51.191421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:51.194271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:51.528043 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:51.538876 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:51.541916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:51.543380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-42edf15d-18c2-4284-9911-a64d32b66af1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.392444 Jun 17 07:22:51.545098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 205/416] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:51 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:52.562894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:52.564337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:52.579546 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:52.581618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:52.582586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:52.587653 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:52.588213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:52.828696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:52.832536 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:52.845987 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:52.847865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:52.858690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5c813806-5f94-4662-bfa0-ce2906aa3ee9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.295222 Jun 17 07:22:52.861691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 212/417] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:52 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:53.743940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'create', calling method: .version_select at 0x7f8b6d68a0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1140170078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8fg9GeL7UlYK7wzMGauQEGFsiukqiV3NPsf6sN2rizGY0dWSG4/yT+xI+vLkzX4atBR5vpPJGCZD6bX4FvxOQ/lGaJvH5O+/1M8o7bcE8TQREKcGTzSihd5yaxZd1ZfA=="}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:53.759989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Getting quotas for project 52a029f97a9e4142802a9786ae2f6d58. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:22:53.763960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Getting quotas for user a21116ea64234269bba8b0369fb19b59 and project 52a029f97a9e4142802a9786ae2f6d58. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:22:53.776551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR oslo.messaging._drivers.impl_rabbit [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [6aea524d-e603-4f89-ae1c-3cf143b7a717] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 07:22:53.879148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:53.880396 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:53.890042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:53.890708 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:53.891706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:53.892335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:54.060255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:54.070173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:54.071817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:54.073088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bddfa967-9195-4aaa-b082-2be914869dcb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.197988 Jun 17 07:22:54.073726 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 213/418] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:53 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:54.785512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [6aea524d-e603-4f89-ae1c-3cf143b7a717] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37924. Jun 17 07:22:54.806638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-da2aae4f-af93-48b7-9304-bdd225a6487a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.067566 Jun 17 07:22:54.807239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 206/419] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:22:53 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:22:54.865779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1083783685", "imageRef": "ab05ce29-df14-4992-a4fd-6c37a67c8571", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1140170078", "networks": [{"uuid": "d4261208-8732-4882-af5c-da7bee4077d9"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:22:55.092756 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:55.093311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:55.104672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:55.105362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:55.106304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:55.106886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:55.111509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:22:55.310636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:55.328945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:55.330538 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:55.331742 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7c3a3658-ba5e-44bd-98a3-b41d9cad7ba6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.243282 Jun 17 07:22:55.332322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 207/420] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:55 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:55.836228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] validate_networks() for [('d4261208-8732-4882-af5c-da7bee4077d9', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:22:56.205798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:22:56.206269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:22:56.206734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:22:56.207180 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:22:56.207882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:22:56.218562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:56.219004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:56.220144 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:56.220738 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:56.241272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Getting quotas for project 52a029f97a9e4142802a9786ae2f6d58. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:22:56.245744 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Getting quotas for user a21116ea64234269bba8b0369fb19b59 and project 52a029f97a9e4142802a9786ae2f6d58. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:22:56.257286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:22:56.259549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab05ce29-df14-4992-a4fd-6c37a67c8571',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:22:56.307286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4f2a30f4-663a-4705-9e67-3079020bcbf8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445696 Jun 17 07:22:56.308125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 214/421] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:22:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:22:56.317528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d1904ebe-e0a4-40e8-8caf-780212e9f758 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:56.319905 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d1904ebe-e0a4-40e8-8caf-780212e9f758 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:56.351290 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:56.351906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:56.359429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:56.359883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:56.360682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:56.361127 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:56.379839 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d1904ebe-e0a4-40e8-8caf-780212e9f758 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:56.387456 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d1904ebe-e0a4-40e8-8caf-780212e9f758 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1259 microversion: 2.1 time: 0.073648 Jun 17 07:22:56.396838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 208/422] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:56 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:56.512032 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:56.522087 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:56.524193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:56.525615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-016f75e0-4c50-4582-9692-435056f23396 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.178276 Jun 17 07:22:56.526248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 215/423] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:56 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:57.404963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:57.405571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:57.412877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:57.413323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:57.414082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:57.414773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:57.475538 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:57.483234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-48eb5522-0fe5-4e35-9930-042f3ba8f7b9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1263 microversion: 2.1 time: 0.082237 Jun 17 07:22:57.483821 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 209/424] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:57 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:57.544330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:57.544923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:57.552117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:57.552581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:57.553349 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:57.553918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:57.690972 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:57.699222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:57.700739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:57.701872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c14e5864-e37e-4322-9a41-e56a2d4e9119 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.161544 Jun 17 07:22:57.702424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 216/425] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:57 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:22:58.500351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:58.501023 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:58.508133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:58.509379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:58.510225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:58.510653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:58.572972 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:58.580390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b729fb0a-a125-4d52-89c4-7e2202cd045d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1263 microversion: 2.1 time: 0.084122 Jun 17 07:22:58.580943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 210/426] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:58 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:22:58.720757 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:58.721362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:58.728375 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:58.728822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:58.729575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:58.730013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:58.863157 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:58.872242 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:58.873755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:58.874900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cc295557-0916-4269-b14e-31195676300b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.158524 Jun 17 07:22:58.875527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 217/427] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:58 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:22:59.596698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:59.597298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:59.603811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:59.604289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:59.605037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:59.605462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:59.670950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:22:59.679145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1bd5d07b-ca3c-4268-8778-59797e73bcdf tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1311 microversion: 2.1 time: 0.086149 Jun 17 07:22:59.679734 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 211/428] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:22:59 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:22:59.893093 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:22:59.893735 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:22:59.900953 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:59.901400 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:22:59.902165 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:22:59.902599 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:00.032705 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:00.041502 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:00.043069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:00.044261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e99acc08-1984-4013-b43d-57606d95b304 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.155233 Jun 17 07:23:00.045004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 218/429] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:22:59 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:00.696039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:00.696671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:00.703250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:00.703688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:00.704475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:00.704901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:00.765091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:00.772539 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1a30a717-c8c8-4615-a7ff-cc1e4386ae1f tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1311 microversion: 2.1 time: 0.080335 Jun 17 07:23:00.773087 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 212/430] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:00 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1311 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:01.063119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:01.063638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:01.070222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:01.070673 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:01.071495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:01.071932 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:01.206659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:01.215666 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:01.217214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:01.218353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-39281171-36e1-41da-b470-cb10ef3b4e5a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.159965 Jun 17 07:23:01.218901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 219/431] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:01 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:01.790225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:01.791104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:01.797334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:01.797782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:01.798549 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:01.798980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:01.860998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:01.868476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-43365f43-889d-4172-8ae6-8eef5753abb9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1311 microversion: 2.1 time: 0.082458 Jun 17 07:23:01.869039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 213/432] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:01 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:02.236827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:02.237434 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:02.244632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:02.245081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:02.245839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:02.246276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:02.375904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:02.384555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:02.385998 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:02.387155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-45500c7b-fb2b-4796-9f77-f0559eee59c2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.154221 Jun 17 07:23:02.387715 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 220/433] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:02 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:02.886398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:02.887174 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:02.893477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:02.894096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:02.894881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:02.895308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:03.000950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:03.012227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c7d1ef91-0f27-4e53-8fff-15322581b0f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1317 microversion: 2.1 time: 0.129729 Jun 17 07:23:03.013469 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 214/434] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:02 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1317 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:03.410132 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:03.410811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:03.420320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:03.422896 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:03.427860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:03.428541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:03.779584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:03.820301 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:03.822884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:03.833735 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e1dbec76-8acf-4c4f-a5f2-a82fee3f592b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.431901 Jun 17 07:23:03.835679 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 221/435] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:03 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:04.029711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:04.030457 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:04.037823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.038619 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.040435 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.041086 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.342971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:04.357329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7a2f592c-2a1a-4023-b2e4-30c0cba84da0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.331261 Jun 17 07:23:04.358533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 215/436] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:04 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:04.458459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dced1ad2-89c7-4165-b73c-23a2f804b8c4"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:04.463199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:04.463199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:04.481011 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.481461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.482238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.482668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.702520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-dd30262b-d5dc-4c02-aaaa-ad0c29256aec req-7ec561ff-b2a8-4970-a373-37b78f6430c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:04.747118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-dd30262b-d5dc-4c02-aaaa-ad0c29256aec req-7ec561ff-b2a8-4970-a373-37b78f6430c4 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.752297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-dd30262b-d5dc-4c02-aaaa-ad0c29256aec req-7ec561ff-b2a8-4970-a373-37b78f6430c4 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.783846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-dd30262b-d5dc-4c02-aaaa-ad0c29256aec req-7ec561ff-b2a8-4970-a373-37b78f6430c4 service nova] Creating event network-changed:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:23:04.797265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-dd30262b-d5dc-4c02-aaaa-ad0c29256aec req-7ec561ff-b2a8-4970-a373-37b78f6430c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113366 Jun 17 07:23:04.798320 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 216/437] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:23:04.855141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:04.855849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:04.866224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.866861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:04.868777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:04.869704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:05.051960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:05.066202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:05.068603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:05.070536 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c95f2432-d3dc-4bf3-913a-a6a588383bc6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.221008 Jun 17 07:23:05.071665 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 217/438] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:04 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:05.374049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:05.374588 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:05.380754 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:05.381201 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:05.381958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:05.382395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:05.527951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:05.535606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1f7d04c7-598e-463d-9e63-430dd2b1cd87 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.165556 Jun 17 07:23:05.536210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 218/439] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:05 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:06.088963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:06.089890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:06.096765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.097219 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:06.098169 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.098756 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:06.230660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:06.238467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:06.248262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:06.250065 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:06.251744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-00f7b2ce-f7b0-45af-9dde-cb7a77e5ade5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.166940 Jun 17 07:23:06.252954 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 219/440] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:06 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:06.253153 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:06.552603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:06.553202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:06.555218 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:06.566017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.566457 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:06.567214 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.567643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:06.700712 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:06.710809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ac316066-6e84-4e46-bd0c-89317aa82269 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.161906 Jun 17 07:23:06.711396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 220/441] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:06 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:06.945338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:06.946717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:06.953659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.954106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:06.954877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:06.955312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:07.085463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lazy-loading 'services' on Instance uuid 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:23:07.205958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e470d526-03b1-4224-ac38-a63489690ee4 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1/os-volume_attachments/49fd7109-0cb6-4d77-bec4-3cc57a6d95dc" status: 202 len: 0 microversion: 2.1 time: 0.264277 Jun 17 07:23:07.209733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 221/442] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:23:06 2022] DELETE /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1/os-volume_attachments/49fd7109-0cb6-4d77-bec4-3cc57a6d95dc => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:23:07.272393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:07.273200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:07.280266 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:07.280727 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:07.281511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:07.281948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:07.421057 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:07.430019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:07.432042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:07.433218 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-45c5dc43-ce9b-42ea-939b-1a7799475a85 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.165228 Jun 17 07:23:07.433982 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 222/443] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:07 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:07.728417 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:07.728975 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:07.735457 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:07.735992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:07.736888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:07.737491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:07.893368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:07.909585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3745ccd4-be3e-4a15-b1fc-b63d967a848b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.186591 Jun 17 07:23:07.910613 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 223/444] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:07 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:08.451491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:08.452894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:08.461511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:08.461971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:08.462758 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:08.463192 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:08.603464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:08.605719 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:08.613952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:08.615581 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:08.616889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-81d0d5f8-69a1-405a-bbc2-27a46038d58e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.169507 Jun 17 07:23:08.617528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 224/445] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:08 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:08.934597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:08.935437 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:08.943710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:08.944420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:08.945268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:08.945792 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:09.081046 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:09.089285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-79865517-d8e1-40bf-818e-9bffc7893577 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.159278 Jun 17 07:23:09.090061 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 225/446] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:08 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:09.635846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:09.636916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:09.644478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:09.644929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:09.645710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:09.646148 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:09.780186 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:09.788969 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:09.790766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:09.795339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2af4877e-1381-4f50-8dd2-45f0b4de1335 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.164304 Jun 17 07:23:09.796020 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 226/447] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:09 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:10.113522 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:10.114223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:10.121233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:10.121766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:10.122668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:10.123141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:10.259141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:10.268464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-42760fe8-73c1-455e-8cbb-c0a235555b47 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.158531 Jun 17 07:23:10.269226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 227/448] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:10 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:10.814274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:10.814995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:10.822304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:10.822753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:10.823527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:10.823963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:10.958920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:10.968589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:10.970178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:10.971410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7350f8a3-fbb5-4cc8-a853-c02f1c58c660 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.161098 Jun 17 07:23:10.980141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 228/449] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:10 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:11.167702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-972564018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-578391782", "security_groups": [{"name": "tempest-secgroup-smoke-422647402"}], "networks": [{"uuid": "5cda22a3-ed9a-495c-94c5-566aedd4005f"}], "block_device_mapping_v2": [{"uuid": "8d0ceedf-a2fc-48b3-9c48-c6c05cd2ab09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:11.292157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] validate_networks() for [('5cda22a3-ed9a-495c-94c5-566aedd4005f', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:23:11.688220 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:23:11.688648 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:23:11.689149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:23:11.689559 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:23:11.689977 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:23:11.699556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:11.700119 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:11.700915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:11.701346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:11.719666 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Getting quotas for project f92a857cef0a43d4907fbc667e30df6d. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:23:11.723787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Getting quotas for user 86f2cda914b74f979746f4fb370eaae6 and project f92a857cef0a43d4907fbc667e30df6d. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:23:11.784975 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:23:11.787392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d0ceedf-a2fc-48b3-9c48-c6c05cd2ab09',volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:23:11.928021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ccf46732-d03a-4b44-b44a-d61a088c9caa tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764371 Jun 17 07:23:11.928806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 229/450] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:23:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:23:11.933139 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:11.933715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:11.940358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:11.940798 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:11.941546 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:11.941971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:12.077947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:12.086327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-97ece651-9b74-49fb-9763-b105acdca9ac tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.156678 Jun 17 07:23:12.087394 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 230/451] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:11 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:12.092361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa96d75b-9fef-405f-8761-2dcbdd0387ac tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:12.093136 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-aa96d75b-9fef-405f-8761-2dcbdd0387ac tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:12.148884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-aa96d75b-9fef-405f-8761-2dcbdd0387ac tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:12.156014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-aa96d75b-9fef-405f-8761-2dcbdd0387ac tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1087 microversion: 2.1 time: 0.067689 Jun 17 07:23:12.156610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 231/452] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:12 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:12.161017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:12.161603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:12.168795 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:12.169338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:12.170156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:12.170653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:12.304920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:12.313140 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:12.314618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:12.315778 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bb8eb869-2ef8-43e0-9de3-5fbee4ee942d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.158275 Jun 17 07:23:12.316373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 232/453] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:12 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:13.104414 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:13.105013 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:13.111541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.111990 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.112776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.113209 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.244272 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:13.251522 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5846b41a-0b18-498b-95c8-e35997c0794e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.151553 Jun 17 07:23:13.252097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 233/454] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:13 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:13.256503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:13.257121 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:13.263552 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.264024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.264881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.265313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.323803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:13.331175 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7f135991-a2a4-437d-93fb-db5ccf394fca tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1129 microversion: 2.1 time: 0.078150 Jun 17 07:23:13.331734 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 234/455] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:13 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1129 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:13.336022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:13.337169 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:13.342666 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.343110 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.343867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:13.344321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:13.549146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7099d6dc-96a7-430d-99de-339753898e52 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.094957 Jun 17 07:23:13.550112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 222/456] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:23:04 2022] POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 194 bytes in 9097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:13.582172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:13.592162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:13.593657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:13.594816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-50b19736-9e7d-435a-b9c7-fc99140493ea tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.262155 Jun 17 07:23:13.595373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 235/457] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:13 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:14.271158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:14.272265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:14.286704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.287331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.288233 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.288770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.348698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:14.349985 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:14.357540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.358311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.360602 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.360983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.453513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:14.464646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ace41ed1-47f7-4194-ae47-06c4212acac4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1203 microversion: 2.1 time: 0.120361 Jun 17 07:23:14.465652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 236/458] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:14 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1203 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:14.613746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:14.614429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:14.627531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.627983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.630403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.631010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.791891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:14.800003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-04068564-5db6-4d1e-92c5-0caa22353340 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.535637 Jun 17 07:23:14.801063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 223/459] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:14 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:14.806543 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:14.807028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:14.813938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.814585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.815449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.815876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.846270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:23:14.851058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:14.860278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:14.861764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:14.863161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6a5371e2-b475-4917-bc55-606b1c7483a4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.253878 Jun 17 07:23:14.863708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 237/460] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:14 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:14.922790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-05f1058c-ff0f-46d0-bab4-0896c015ad47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 204 len: 0 microversion: 2.1 time: 0.119858 Jun 17 07:23:14.923498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 224/461] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:23:14 2022] DELETE /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:23:14.931870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:14.932500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:14.938357 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.938805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:14.939616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:14.940051 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.070549 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:15.078109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b16f4b02-1c28-4587-8b97-8a85334a64ea tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1512 microversion: 2.1 time: 0.150264 Jun 17 07:23:15.078670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 238/462] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:14 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:15.481578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:15.482212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:15.488817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.489260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.490017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.490448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.551984 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:15.559869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-86a8032c-9bf9-4a67-a1ce-6e2f3ffd4cf2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1203 microversion: 2.1 time: 0.082669 Jun 17 07:23:15.560667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 225/463] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:15 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1203 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:15.817723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:15.818265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:15.825366 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.825817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.826578 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.827015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.881138 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:15.881749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:15.890960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.891431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.892272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:15.892850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:15.961812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:15.969321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-189b009b-43a4-40ed-9cd6-81e15f37b9f7 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.155524 Jun 17 07:23:15.969964 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 239/464] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:15 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:16.091772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:16.094675 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:16.095430 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:16.097498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:16.103273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:16.103461 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.103733 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:16.104721 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.105162 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:16.105294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:16.106421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-18636227-8b2a-4bc9-9d15-36a9795b997e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.229231 Jun 17 07:23:16.107059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 226/465] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:15 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:16.248118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:16.255610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3382dfb9-4377-426a-ad5e-040676850833 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1512 microversion: 2.1 time: 0.164809 Jun 17 07:23:16.256369 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 240/466] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:16 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:16.578260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:16.578869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:16.585542 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.585989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:16.586781 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.587213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:16.591474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:16.724158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:16.732259 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b27efa41-e48c-43d5-839f-4bd920397a48 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1270 microversion: 2.1 time: 0.159231 Jun 17 07:23:16.732822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 227/467] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:16 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:16.986838 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:16.987451 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:16.994706 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.995154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:16.995914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:16.996511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.121723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.124897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:17.126079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:17.129732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3a92c3e4-acd0-47ec-8886-dc4292c99137 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.146779 Jun 17 07:23:17.130482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 241/468] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:16 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:17.141002 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.141542 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.142237 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.142685 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.257363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-ef9693a6-cd8c-4ed6-9802-83100c057bf5 req-7a81fc09-2ca7-402b-ad6a-20991ff7dbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "name": "network-vif-plugged", "status": "completed", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:17.266533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ef9693a6-cd8c-4ed6-9802-83100c057bf5 req-7a81fc09-2ca7-402b-ad6a-20991ff7dbee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.267391 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ef9693a6-cd8c-4ed6-9802-83100c057bf5 req-7a81fc09-2ca7-402b-ad6a-20991ff7dbee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.276904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.284144 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-ef9693a6-cd8c-4ed6-9802-83100c057bf5 req-7a81fc09-2ca7-402b-ad6a-20991ff7dbee service nova] Creating event network-vif-plugged:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:23:17.289222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.290527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-ef9693a6-cd8c-4ed6-9802-83100c057bf5 req-7a81fc09-2ca7-402b-ad6a-20991ff7dbee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036695 Jun 17 07:23:17.291005 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.291282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 242/469] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:17.292195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-37fb8e99-e46d-4bfc-8608-68e673322364 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.171375 Jun 17 07:23:17.292739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 228/470] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:17 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:17.297180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:17.297873 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:17.304750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.305702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.306952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.307392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.438036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.440340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:17.447441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f80ca808-3c49-4b8e-8364-c892d5c444a2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1512 microversion: 2.1 time: 0.154632 Jun 17 07:23:17.447993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 243/471] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:17 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:17.749004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:17.749606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:17.756339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.756912 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.757669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:17.758101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:17.978552 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:17.985975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-68b60e4e-520c-49db-950e-3b1438d5fde9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1270 microversion: 2.1 time: 0.240765 Jun 17 07:23:17.986540 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 229/472] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:17 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:18.149877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:18.151072 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:18.158607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.159249 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.160036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.160499 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.304786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:18.310962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:18.311698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:18.313298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-418e6494-4bfb-4374-8e8f-669b7f619ec2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.170345 Jun 17 07:23:18.322853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 244/473] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:18 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:18.322853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-a298f630-7bd0-41dc-b325-21bae840b237 req-8ceabbc3-3bc4-45c3-81d1-b4ecc2421568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:18.324243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.324798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.325668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.327540 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.331223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-a298f630-7bd0-41dc-b325-21bae840b237 req-8ceabbc3-3bc4-45c3-81d1-b4ecc2421568 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.331603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-a298f630-7bd0-41dc-b325-21bae840b237 req-8ceabbc3-3bc4-45c3-81d1-b4ecc2421568 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.345649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-a298f630-7bd0-41dc-b325-21bae840b237 req-8ceabbc3-3bc4-45c3-81d1-b4ecc2421568 service nova] Creating event network-changed:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:23:18.354138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-a298f630-7bd0-41dc-b325-21bae840b237 req-8ceabbc3-3bc4-45c3-81d1-b4ecc2421568 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036255 Jun 17 07:23:18.354885 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 245/474] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:18.464960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:18.465749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:18.472557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.473285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.474066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:18.474491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:18.484367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:18.496135 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:18.497847 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:18.499119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-43696f2f-c77f-451d-9fa9-2076a1febb1e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.192534 Jun 17 07:23:18.499965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 230/475] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:18 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:18.615060 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:18.623324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e51b0544-1dea-4f09-a09e-e09b1ae8f9dc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1512 microversion: 2.1 time: 0.162690 Jun 17 07:23:18.623987 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 246/476] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:18 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:19.003324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:19.003944 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:19.015638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.016114 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.016897 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.017335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.290632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.302527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3ea6f643-06e2-4189-b575-5aea0b0ba187 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1270 microversion: 2.1 time: 0.303542 Jun 17 07:23:19.303222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 231/477] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:18 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:19.317344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-3800380b-dc16-46cc-b6eb-93a56e1ebbf3 req-eb2172c6-045b-48c5-be8c-24755bbe4169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "name": "network-vif-plugged", "status": "completed", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:19.326823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3800380b-dc16-46cc-b6eb-93a56e1ebbf3 req-eb2172c6-045b-48c5-be8c-24755bbe4169 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.327504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3800380b-dc16-46cc-b6eb-93a56e1ebbf3 req-eb2172c6-045b-48c5-be8c-24755bbe4169 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.330735 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:19.331353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:19.337520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.337976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.338747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.339189 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.339829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-3800380b-dc16-46cc-b6eb-93a56e1ebbf3 req-eb2172c6-045b-48c5-be8c-24755bbe4169 service nova] Creating event network-vif-plugged:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:23:19.345130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-3800380b-dc16-46cc-b6eb-93a56e1ebbf3 req-eb2172c6-045b-48c5-be8c-24755bbe4169 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031300 Jun 17 07:23:19.348663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 247/478] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:19.518221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:19.519341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:19.526370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.527348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.528348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.528870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.564750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.582167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7d46a4f7-6477-4ca8-9595-47d987ac69fb tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.255591 Jun 17 07:23:19.591982 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 232/479] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:19 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:19.644007 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:19.646589 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:19.651667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.652137 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.652909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:19.653337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:19.729613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.737733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f456d5ec-e9d1-4034-b7fe-9525d67e7111 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1470 microversion: 2.1 time: 0.097625 Jun 17 07:23:19.738313 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 233/480] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:19 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:19.772480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.780852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.782364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:19.783510 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-43459dc9-7a4a-4940-9aa6-f80e60b1f0d6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.270604 Jun 17 07:23:19.783510 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 248/481] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:19 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:19.992710 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:19.994248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.000316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.000764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.001509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.001940 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.025350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'flavor' on Instance uuid 76b63dc8-cc11-45bc-9017-47ddc80690e1 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:23:20.175386 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-49d66bca-8cc9-4d21-bacf-204264e3f6d5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/action" status: 200 len: 32 microversion: 2.1 time: 0.186475 Jun 17 07:23:20.176032 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 234/482] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:23:19 2022] POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:23:20.185749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:20.186363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.193007 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.193459 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.194216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.194651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.319729 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:20.320475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.324714 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.327624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.328087 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.328895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.329327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.333240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-488828a5-3d75-41a4-a3ce-9427d7aacc47 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.151219 Jun 17 07:23:20.333842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 249/483] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:20 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:20.369867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-c3c4afc1-e0fd-4c71-b4bb-e78e3f3be205 req-d282ca28-153b-4078-8077-dfc094540a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1", "name": "network-vif-deleted", "tag": "1dfb0adf-408e-4ceb-92dc-92eadc56d5e4"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:20.378090 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-c3c4afc1-e0fd-4c71-b4bb-e78e3f3be205 req-d282ca28-153b-4078-8077-dfc094540a1c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.378532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-c3c4afc1-e0fd-4c71-b4bb-e78e3f3be205 req-d282ca28-153b-4078-8077-dfc094540a1c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.390712 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-c3c4afc1-e0fd-4c71-b4bb-e78e3f3be205 req-d282ca28-153b-4078-8077-dfc094540a1c service nova] Creating event network-vif-deleted:1dfb0adf-408e-4ceb-92dc-92eadc56d5e4 for instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 on hv-cinder-83482 Jun 17 07:23:20.395616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-c3c4afc1-e0fd-4c71-b4bb-e78e3f3be205 req-d282ca28-153b-4078-8077-dfc094540a1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 Jun 17 07:23:20.396280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 250/484] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:23:20.485982 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.494999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6ddd5b80-3455-46a5-aca0-fa578fbae8c2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1270 microversion: 2.1 time: 0.179394 Jun 17 07:23:20.496575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 235/485] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:20 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:20.599155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:20.599855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.606573 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.607019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.607771 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.608238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.733998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.741336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-93e2abed-e735-459b-85bb-9067916eaf59 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.146448 Jun 17 07:23:20.741899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 251/486] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:20 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:20.754592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:20.755208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.762648 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.763097 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.763857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.764324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.794596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.795048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.795504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lazy-loading 'fault' on Instance uuid 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:23:20.802671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:20.803304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:20.809902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.810350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.811111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:20.811543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:20.841410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.848900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-730c24be-4cec-43de-87e6-20d40b5a5cca tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1307 microversion: 2.1 time: 0.098192 Jun 17 07:23:20.849472 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 236/487] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:20 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:20.947836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.957268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.959143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:20.960455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-730f93bc-c99d-4468-bf07-af9e2a30d1f0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.161652 Jun 17 07:23:20.961154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 252/488] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:20 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:23:21.351045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:21.351776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:21.358962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.359492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.360413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.360921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.490093 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:21.498734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0cb12613-9917-4b81-b844-583627ab461c tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.151890 Jun 17 07:23:21.499297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 237/489] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:21 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:21.512736 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:21.513354 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:21.519879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.520501 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.521264 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.521696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.649323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:21.656819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f74447e5-841a-4608-998b-acd7ad0ade0c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.147970 Jun 17 07:23:21.657387 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 253/490] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:21 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:21.757793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:21.758439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:21.764442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.764891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.765640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.766071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.865898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:21.866562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:21.868830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:21.874259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.874711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.875484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.875927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.894995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:21.903164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b16b35ba-9fdf-4a41-a3e5-960ee35f6c4d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1359 microversion: 2.1 time: 0.149238 Jun 17 07:23:21.903846 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 238/491] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:21 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:21.906691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.907144 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.907588 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lazy-loading 'fault' on Instance uuid 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:23:21.947942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:21.955244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-88295bfa-131c-4b10-ad0e-eefcd4cd6cff tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 200 len: 1307 microversion: 2.1 time: 0.093329 Jun 17 07:23:21.955807 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 254/492] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:21 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:21.978669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:21.979279 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:21.985472 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.985921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:21.986681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:21.987110 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.112412 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:22.122200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:22.123641 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:22.124821 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b1b57d72-6fd5-4996-aea7-4da080c22c7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1809 microversion: 2.20 time: 0.150064 Jun 17 07:23:22.125389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 239/493] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:21 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:22.515483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:22.516110 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:22.517944 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=8 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:22.524877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.525319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.526073 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.526499 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.654906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:22.662802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-89623b3f-566a-427d-9892-79bb9ec232c5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.151177 Jun 17 07:23:22.663376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 255/494] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:22 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:22.673924 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:22.674522 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:22.680992 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.681432 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.682194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.682615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.889490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:22.897321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1428bcde-1ac3-4523-89ce-783db38eebcb tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.227122 Jun 17 07:23:22.897892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 240/495] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:22 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:22.921463 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:22.922082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:22.928272 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.928722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.929487 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.929920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.972618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:22.973229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:22.980384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.980839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.981608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:22.982043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:22.997154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] HTTP exception thrown: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Request method failure captured: Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 HTTP/1.1 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCuZk4W6mdPgmA3z0W6CgmUhZzlo20qFDJ52V9V8x3rR-usEj1xKrTVv3B4kb9M_D9pJx915KtLr02mceIHINm0E05HNOlNEusHcqV_PPeGHnG0kqdlWSuNW5CzhCjmaMWs7lvMaKLLynuU23ocCnhDuwQobjEyRIOU7h4jF61wwc4I Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 71a5393056b74f1e871bb50775a40554 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:23:22.999504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71a5393056b74f1e871bb50775a40554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71a5393056b74f1e871bb50775a40554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71a5393056b74f1e871bb50775a40554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71a5393056b74f1e871bb50775a40554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 71a5393056b74f1e871bb50775a40554 Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-VolumesSnapshotTestJSON-68639704-project Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 7615cf807ce746ada15efa0ff1cb80d7 Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-VolumesSnapshotTestJSON-68639704-project Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. Jun 17 07:23:23.000871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1'} Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:23:23.001669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. Jun 17 07:23:23.002928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:23:23.004039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Returning 404 to user: Instance 4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:23:23.004039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c02971ef-073a-4851-8bdd-8af336d19c23 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1" status: 404 len: 111 microversion: 2.1 time: 0.031478 Jun 17 07:23:23.004039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 241/496] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:22 2022] GET /compute/v2.1/servers/4c6dfaf2-a3d5-4b1d-a9bf-ae2e6bbb07f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:23:23.074044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.086085 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3f89111a-a0d6-4cb8-a27a-e01d96729e42 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1548 microversion: 2.1 time: 0.167801 Jun 17 07:23:23.087950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 256/497] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:22 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:23.108258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.109140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:23.117075 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.117848 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.118718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.119211 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.124049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:23.148021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.148658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:23.158980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.159360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.160156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.160587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.304260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.308170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.311985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-18d062f9-024e-4b83-a694-df757a8f481d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1548 microversion: 2.1 time: 0.210876 Jun 17 07:23:23.312588 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 242/498] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:23.316971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.318572 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.319807 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-dd356cf4-ba89-444c-a1dc-921b01ed9ca1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1796 microversion: 2.20 time: 0.178312 Jun 17 07:23:23.320471 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 257/499] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1796 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:23:23.327330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.330921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.332281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Searching by: {'deleted': False, 'project_id': '52a029f97a9e4142802a9786ae2f6d58'} {{(pid=117395) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 07:23:23.339487 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.339926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.340737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.341168 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.431696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.multi_cell_list [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117395) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 07:23:23.523064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ab31d3f3-0fb7-49e4-b776-a03a949707f6 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199474 Jun 17 07:23:23.523640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 243/500] 10.222.0.33 () {58 vars in 1124 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:23.534449 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.535063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:23.542329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.542776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.543534 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.543962 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.668662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.676050 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c1a042cc-3c05-4beb-af22-d68798429ad9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1548 microversion: 2.1 time: 0.145499 Jun 17 07:23:23.676575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 258/501] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:23.680731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.681342 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:23.687714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.688191 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.688951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.689384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.820428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:23.830092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-31587bed-7fda-4901-be6f-e6654073c834 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.153254 Jun 17 07:23:23.830671 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 244/502] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:23.913850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:23.914592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:23.921117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.921566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:23.922390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:23.922827 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:24.070684 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:24.078962 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7cdd9271-e914-4a47-b20f-b00753a275a2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.168911 Jun 17 07:23:24.079524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 259/503] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:23 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:24.848274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:24.848879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:24.855921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:24.856395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:24.857142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:24.857576 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:24.987812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:24.995922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-66e0a267-051b-4655-8bf9-250eff6b57a5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.151480 Jun 17 07:23:24.996521 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 245/504] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:24 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:25.094560 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:25.095160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:25.101669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:25.102599 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:25.103350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:25.103776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:25.233625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:25.241018 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-68d18c56-02ba-4b36-8d41-38ab1f3fcc8a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.150359 Jun 17 07:23:25.241575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 260/505] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:25 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:26.013074 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:26.013684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:26.020280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.020731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:26.021516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.021955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:26.156295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:26.164406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-365fa683-171c-4f27-86b5-62d32003a1bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.155167 Jun 17 07:23:26.165815 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 246/506] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:26 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:26.257827 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:26.258982 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:26.265582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.265968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:26.266718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.267181 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:26.397881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:26.405316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7b0982b7-d3e7-44a7-aa85-35007f2b4e70 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.151394 Jun 17 07:23:26.405871 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 261/507] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:26 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:26.948515 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:26.949004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:26.955100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.955547 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:26.956330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:26.956768 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.078185 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lazy-loading 'services' on Instance uuid 73a8c90c-c561-4193-8276-ae0351b550f4 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:23:27.184041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:27.184784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:27.191421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.192097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.192975 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.193477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.193803 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-326f8aa3-f7c6-41be-81ba-6e1f408b4f78 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments/6298009c-b280-4a18-ad23-e45d85334d29" status: 202 len: 0 microversion: 2.1 time: 0.249593 Jun 17 07:23:27.194623 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 247/508] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:23:26 2022] DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments/6298009c-b280-4a18-ad23-e45d85334d29 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:23:27.197308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:27.325601 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa4fefc1-a9aa-4e89-8105-1f188d0d9530"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:27.326899 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:27.339189 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.339714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.340612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.341107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.376590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:27.387568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-51b84323-b10a-4c93-96a3-9472a7ba429e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.206718 Jun 17 07:23:27.395330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 262/509] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:27 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:27.423980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:27.424891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:27.432025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.432324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.433149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:27.433704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:27.564005 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:27.571879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0a21f075-9b6a-426f-b550-f4628fea9005 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.153567 Jun 17 07:23:27.572691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 263/510] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:27 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:27.859660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-28473524-aa47-41d2-aaa1-740caaa3e400 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538167 Jun 17 07:23:27.860312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 248/511] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:23:27 2022] POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:28.403232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:28.403774 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:28.410276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:28.410717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:28.411464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:28.411890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:28.536006 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:28.544743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5a45e5d6-5d8a-4787-b963-4eeaf2cbebf4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.145930 Jun 17 07:23:28.545352 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 264/512] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:28 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:28.590622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:28.591326 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:28.597529 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:28.597978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:28.598740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:28.599178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:28.742245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:28.750028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-26369f2b-39dc-4d93-9354-54a43334cd39 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.164151 Jun 17 07:23:28.750578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 249/513] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:28 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:29.562172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:29.562784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:29.569342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:29.569726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:29.570479 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:29.570910 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:29.698027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:29.705919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-261e56a5-04be-48ff-9628-a6df5865159b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.147626 Jun 17 07:23:29.706508 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 265/514] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:29 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:29.766993 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:29.767604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:29.774303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:29.774750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:29.775505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:29.775936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:29.905743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:29.913306 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fdf61b41-5821-4601-b1a4-c761d1e6c07a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.150083 Jun 17 07:23:29.913864 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 250/515] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:29 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:30.723319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:30.723931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:30.731017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:30.731467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:30.732275 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:30.732710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:30.858710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:30.866530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7df379c1-95dc-49b2-b88b-f8b3b7141e78 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.147076 Jun 17 07:23:30.867093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 266/516] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:30 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:30.930593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:30.931213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:30.937813 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:30.938266 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:30.939024 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:30.939465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:31.068374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:31.075990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b538e042-16eb-4d51-97a1-0b080a6e073a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.149745 Jun 17 07:23:31.076715 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 251/517] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:30 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:31.885744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:31.887064 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:31.900152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1403146531", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "networks": [{"uuid": "d085d43f-8332-461f-be16-9921b6cc7d81"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:31.909196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:31.909662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:31.910450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:31.910888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:31.972832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] validate_networks() for [('d085d43f-8332-461f-be16-9921b6cc7d81', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:23:32.048683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:32.057107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8d92e179-0099-4734-bae1-23e132d35eec tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.176652 Jun 17 07:23:32.057658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 267/518] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:31 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:32.093113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:32.093725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:32.108247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.108247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.108518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.108881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.262822 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:32.272206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-07b896ec-1ea3-4aed-bb32-0ad5b3c3518a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.182625 Jun 17 07:23:32.272989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 268/519] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:32 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:32.364991 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:23:32.365488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:23:32.366053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:23:32.366715 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:23:32.367202 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:23:32.376263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.376731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.377520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.377956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.394622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Getting quotas for project 71a5393056b74f1e871bb50775a40554. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:23:32.398700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Getting quotas for user 7615cf807ce746ada15efa0ff1cb80d7 and project 71a5393056b74f1e871bb50775a40554. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:23:32.410071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:23:32.412350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:23:32.457700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a8fab4ec-c9ce-4418-9d46-b652e3eaa31c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563184 Jun 17 07:23:32.458775 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 252/520] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:23:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:23:32.469104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1e825797-bdd2-40a8-8e2b-ab1881fc3d6b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:32.469936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1e825797-bdd2-40a8-8e2b-ab1881fc3d6b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:32.526450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1e825797-bdd2-40a8-8e2b-ab1881fc3d6b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:32.533749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1e825797-bdd2-40a8-8e2b-ab1881fc3d6b tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1219 microversion: 2.1 time: 0.068641 Jun 17 07:23:32.534911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 269/521] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:32 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:32.549322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-24116769-d78b-48db-bbec-707eaa2cc9d8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:32.556220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-24116769-d78b-48db-bbec-707eaa2cc9d8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.556776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-24116769-d78b-48db-bbec-707eaa2cc9d8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.581593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-24116769-d78b-48db-bbec-707eaa2cc9d8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Going to try to stop instance {{(pid=117395) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 07:23:32.623490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-24116769-d78b-48db-bbec-707eaa2cc9d8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action" status: 202 len: 0 microversion: 2.1 time: 0.077497 Jun 17 07:23:32.624106 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 253/522] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:23:32 2022] POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:23:32.632386 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:32.632999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:32.640188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.640999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.641390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:32.642171 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:32.792584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:32.800173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1ff7c3fd-0e6c-4396-b88d-bcdd73de722c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.171852 Jun 17 07:23:32.800740 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 270/523] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:32 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:33.075190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:33.076139 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:33.083814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.084295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.085054 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.085484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.218511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:33.226474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-184aaabc-d5b0-4d48-8b37-e6cfd41c0245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.156042 Jun 17 07:23:33.227566 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 254/524] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:33 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:33.291293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:33.291952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:33.298237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.298687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.299455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.299886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.412503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-129ed31c-ac35-44a1-a596-5b7b0ae18358 req-4bae8f26-4ac5-47bf-880c-01af42c9940f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "name": "network-vif-plugged", "status": "completed", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:33.422479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-129ed31c-ac35-44a1-a596-5b7b0ae18358 req-4bae8f26-4ac5-47bf-880c-01af42c9940f service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.423183 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-129ed31c-ac35-44a1-a596-5b7b0ae18358 req-4bae8f26-4ac5-47bf-880c-01af42c9940f service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.435307 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-129ed31c-ac35-44a1-a596-5b7b0ae18358 req-4bae8f26-4ac5-47bf-880c-01af42c9940f service nova] Creating event network-vif-plugged:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:23:33.435993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:33.440481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-129ed31c-ac35-44a1-a596-5b7b0ae18358 req-4bae8f26-4ac5-47bf-880c-01af42c9940f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033125 Jun 17 07:23:33.441483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 255/525] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:23:33.446003 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ac4b9c7a-2c2d-4e51-a74a-88fe93e0fc7e tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.159826 Jun 17 07:23:33.446577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 271/526] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:33 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:33.551690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:33.552414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:33.559964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.560608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.561703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.562304 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.625895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:33.629437 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:33.634321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-114c7784-e9e2-4983-a95e-e406d4cce2b1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1279 microversion: 2.1 time: 0.086809 Jun 17 07:23:33.634887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 256/527] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:33 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:33.817281 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:33.818036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:33.824403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.824855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.825654 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:33.826633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:33.965164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:33.972597 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-27bd24ab-99be-4cfc-a489-bb9e82ff6d9c tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.159338 Jun 17 07:23:33.973160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 272/528] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:33 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:34.245177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:34.245793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:34.252930 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.253389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.254154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.254891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.462530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:34.463289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:34.469133 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:34.469997 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.470440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.471200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.471625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.477975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6e1c632a-41c0-4bc2-b1c6-ca6331b21b20 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.237812 Jun 17 07:23:34.478742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 257/529] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:34 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:34.606795 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:34.614784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-22c33f35-517c-4620-9eb0-0dcdfd0cba52 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.155972 Jun 17 07:23:34.615377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 273/530] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:34 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:34.650810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:34.651424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:34.653353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:34.658797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.659246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.660019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.660475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.984215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:34.990338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:34.991240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:34.991965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4da8aad2-f9f3-4bb9-8773-ff30cdfb2f47 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.345021 Jun 17 07:23:34.993275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 258/531] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:34 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:34.998509 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:34.999022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:34.999852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.000375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.132796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:35.140988 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9e42937e-62d2-4e46-90fb-4e84dcc6e7c3 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.154377 Jun 17 07:23:35.141497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 274/532] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:34 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:35.322721 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-8c98cc8e-6b65-4f02-ba0b-417aceca4006 req-f7f5266f-96cd-4264-b736-ec34abddccab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e46be2cb-9619-4e9e-972c-e9fc1a1939f9", "tag": "9775ad68-7c70-469e-904b-93b7d670e84e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:35.331576 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-8c98cc8e-6b65-4f02-ba0b-417aceca4006 req-f7f5266f-96cd-4264-b736-ec34abddccab service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.332018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-8c98cc8e-6b65-4f02-ba0b-417aceca4006 req-f7f5266f-96cd-4264-b736-ec34abddccab service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.344244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-8c98cc8e-6b65-4f02-ba0b-417aceca4006 req-f7f5266f-96cd-4264-b736-ec34abddccab service nova] Creating event network-changed:9775ad68-7c70-469e-904b-93b7d670e84e for instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 on hv-cinder-83482 Jun 17 07:23:35.348995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-8c98cc8e-6b65-4f02-ba0b-417aceca4006 req-f7f5266f-96cd-4264-b736-ec34abddccab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029998 Jun 17 07:23:35.349581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 259/533] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:35.495054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:35.495673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:35.502390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.502846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.503650 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.504115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.631741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:35.632577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:35.633778 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:35.641331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.641784 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.642595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:35.645341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-116fe30a-2d53-431b-9d2e-0966b72919db tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.154095 Jun 17 07:23:35.645905 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 275/534] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:35 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:35.646400 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:35.781783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:35.789232 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f9e36431-d57b-4b57-9796-2325f3afdf15 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1258 microversion: 2.1 time: 0.160915 Jun 17 07:23:35.789797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 260/535] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:35 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:36.009456 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:36.009976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:36.015913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.016396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.017163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.017600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.147793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:36.158017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:36.158468 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-96301261-b01b-4586-b957-2a4a77f9afc1 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.153408 Jun 17 07:23:36.158833 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:36.164164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 276/536] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:36 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:36.169365 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.169815 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.170579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.171016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.383229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:36.391151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1684237b-146c-45b0-9623-9da22d6b530d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.237043 Jun 17 07:23:36.392248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 261/537] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:36 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:36.662683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:36.663315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:36.670735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.671286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.671986 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.672403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.798784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:36.806581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:36.807196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:36.807303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1cd566fd-5ebd-4d45-88c8-d9d813da48e4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.148478 Jun 17 07:23:36.807821 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 277/538] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:36 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:36.813140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.813588 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.814342 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.814774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.940651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:36.948665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2836776a-803b-4c93-8f3e-1353704716c8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1442 microversion: 2.1 time: 0.146493 Jun 17 07:23:36.949234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 262/539] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:36 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:36.964356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:36.964967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:36.970901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.971355 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:36.972138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:36.972574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.099919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:37.107923 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6d45227e-2741-4c3e-9d22-f2c7df274c95 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1442 microversion: 2.1 time: 0.147341 Jun 17 07:23:37.108525 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 278/540] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:36 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1442 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:37.175169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:37.176013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:37.182083 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.182622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.183459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.183980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.325892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:37.334796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7ced2bf8-e830-4708-97d7-cb5d6f38f798 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.163459 Jun 17 07:23:37.335365 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 263/541] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:37 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:37.409331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:37.409858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:37.416315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.416786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.417497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.417924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.621334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:37.623555 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:37.630421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-63e674d7-4fab-4a9b-949e-36121313f181 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.225196 Jun 17 07:23:37.631018 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 279/542] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:37 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:37.825005 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:37.825736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:37.831886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.832447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.833478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:37.833981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:37.970770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:37.978845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9ac44132-5513-462f-8dab-5377ad110245 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.158114 Jun 17 07:23:37.979378 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 264/543] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:37 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:38.352130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:38.352732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:38.359530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:38.359978 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:38.360806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:38.361246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:38.646649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:38.647246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:38.654416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:38.654870 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:38.655636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:38.656084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:38.707168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:38.715882 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e4f03523-8439-4d4e-99f7-9f8d08116bdc tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.367757 Jun 17 07:23:38.716695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 280/544] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:38 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:38.787258 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:38.795702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-83f4a7a1-9b2f-43bf-8384-0cd348161bf7 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.152907 Jun 17 07:23:38.796456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 265/545] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:38 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:38.996592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:38.997216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:39.003610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.004082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.005967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.006437 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.031902 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-1af59453-e3c7-4a38-a9e0-d7923a752225 req-d2795600-07eb-490f-8ab8-70f448493818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:39.041996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-1af59453-e3c7-4a38-a9e0-d7923a752225 req-d2795600-07eb-490f-8ab8-70f448493818 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.041996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-1af59453-e3c7-4a38-a9e0-d7923a752225 req-d2795600-07eb-490f-8ab8-70f448493818 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.054427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-1af59453-e3c7-4a38-a9e0-d7923a752225 req-d2795600-07eb-490f-8ab8-70f448493818 service nova] Creating event network-changed:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:23:39.065762 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-1af59453-e3c7-4a38-a9e0-d7923a752225 req-d2795600-07eb-490f-8ab8-70f448493818 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038263 Jun 17 07:23:39.066815 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 266/546] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:39.179334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:39.191781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6ef9db31-49e9-427a-b962-12d666a76200 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.199497 Jun 17 07:23:39.201145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 281/547] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:38 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:39.632081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:39.632782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:39.640432 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.640884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.641650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.642081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.733608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:39.734216 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:39.746034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.746714 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.747683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.748139 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.785697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:39.796151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cc7b8b2a-42a0-4b1a-a492-2e4d5128dd77 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1594 microversion: 2.1 time: 0.168828 Jun 17 07:23:39.797216 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 267/548] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:39 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1594 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:39.815062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:39.815686 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:39.823530 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.823986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.825630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:39.826072 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:39.909210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:39.917671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b6edac94-bbb5-42d6-8b08-676a627d4be7 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.187857 Jun 17 07:23:39.918249 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 282/549] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:39 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:40.003390 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:40.014394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0082abe1-0061-4c2e-8aad-35a564a7e17f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.204870 Jun 17 07:23:40.015684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 268/550] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:39 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:40.210014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:40.210629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:40.218182 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:40.219119 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:40.220282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:40.220951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:40.424400 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:40.433262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-564139f4-1fc1-4b33-9506-489ae76fbc23 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.227116 Jun 17 07:23:40.434289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 283/551] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:40 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:40.934895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:40.935573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:40.942134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:40.942586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:40.943351 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:40.943840 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.032477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:41.033699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:41.041936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.042465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.043302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.043808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.079329 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:41.087662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0714501e-22fe-4f2b-876f-2fbe0a85d17a tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.157605 Jun 17 07:23:41.088383 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 269/552] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:40 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:41.283518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:41.292033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8631fe33-09df-4a4d-b51d-a3881bb780a1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.263528 Jun 17 07:23:41.292636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 284/553] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:41 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:41.452016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:41.452893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:41.460850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.462273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.463470 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.464180 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.484320 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-9c921138-dab3-425c-8281-3f10f45fcc2d req-bd23e129-68a5-4aab-a872-90dabbfde7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46be2cb-9619-4e9e-972c-e9fc1a1939f9", "name": "network-vif-plugged", "status": "completed", "tag": "9775ad68-7c70-469e-904b-93b7d670e84e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:41.499534 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9c921138-dab3-425c-8281-3f10f45fcc2d req-bd23e129-68a5-4aab-a872-90dabbfde7eb service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.500341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9c921138-dab3-425c-8281-3f10f45fcc2d req-bd23e129-68a5-4aab-a872-90dabbfde7eb service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.513477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-9c921138-dab3-425c-8281-3f10f45fcc2d req-bd23e129-68a5-4aab-a872-90dabbfde7eb service nova] Creating event network-vif-plugged:9775ad68-7c70-469e-904b-93b7d670e84e for instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 on hv-cinder-83482 Jun 17 07:23:41.521344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-9c921138-dab3-425c-8281-3f10f45fcc2d req-bd23e129-68a5-4aab-a872-90dabbfde7eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041625 Jun 17 07:23:41.522939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 285/554] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:41.612047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-cf229f87-75ad-4f46-8b51-b0669271dbf1 req-27a2feff-38c3-4f5b-b432-d93df643cd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:41.613793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:41.624398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-608a6b88-4b72-4770-8fb9-3a0b961b5384 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.176915 Jun 17 07:23:41.626253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-cf229f87-75ad-4f46-8b51-b0669271dbf1 req-27a2feff-38c3-4f5b-b432-d93df643cd00 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:41.626606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 270/555] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:41 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:41.630100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-cf229f87-75ad-4f46-8b51-b0669271dbf1 req-27a2feff-38c3-4f5b-b432-d93df643cd00 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:41.645638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-cf229f87-75ad-4f46-8b51-b0669271dbf1 req-27a2feff-38c3-4f5b-b432-d93df643cd00 service nova] Creating event network-changed:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:23:41.652948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-cf229f87-75ad-4f46-8b51-b0669271dbf1 req-27a2feff-38c3-4f5b-b432-d93df643cd00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045033 Jun 17 07:23:41.653687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 286/556] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:23:42.104872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:42.105632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:42.112387 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.113285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.114187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.114717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.309625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:42.310327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:42.317718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.319365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.322782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.323413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.370931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:42.381114 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b1518eb0-d743-4e64-9807-90f366b8124c tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1319 microversion: 2.1 time: 0.280224 Jun 17 07:23:42.392321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 271/557] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:42 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:42.528126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:42.534307 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:42.542102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5b5043be-7cbb-41e7-a5ba-a419abf81de5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.236596 Jun 17 07:23:42.542682 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 287/558] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:42 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:42.643436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:42.644205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:42.647830 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:42.649969 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:42.655677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.656255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.657164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.657714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.859241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-862094961"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:42.859785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:42.861748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:42.868504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.869274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.870488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:42.870931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:42.878276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:42.887569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-afc1dc86-b24c-4630-b236-8c35316abd77 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.248413 Jun 17 07:23:42.889633 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 272/559] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:42 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:43.044854 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.network.security_group_api [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Adding security group 6f2a66bd-c7eb-4a8b-bcd4-b1e9641ae4fd to port a235c10b-e0ee-4b4f-9226-71c00b1d7f9e Jun 17 07:23:43.399637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:43.400423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:43.407142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.407735 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.408681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.409403 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.433398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bcc1a92f-fc8f-481a-bc0b-beb13d7318ed tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action" status: 202 len: 0 microversion: 2.1 time: 0.578134 Jun 17 07:23:43.438080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 288/560] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:23:42 2022] POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:23:43.443107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:43.443851 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:43.450309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.450872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.451739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.455936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.589347 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:43.599503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-91be16c0-4340-4ec8-bcd5-d12552573334 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1508 microversion: 2.1 time: 0.204502 Jun 17 07:23:43.601167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 273/561] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:43 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:43.608989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:43.609883 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:43.616868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.617691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.618943 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.619575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.659697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:43.676444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5b5e3bda-1b2f-46fd-bc21-f8c361063889 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1640 microversion: 2.1 time: 0.236778 Jun 17 07:23:43.677666 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 289/562] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:43 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1640 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:43.683380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa2b1751-1a24-485a-ae35-dc89517cc2e9", "device": "/dev/sdb"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:43.685153 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:43.691688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.692419 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.693506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.694146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.806006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:43.813101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=100 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:43.815574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e72771c7-c28c-4aa9-add0-dea925d812c1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.210403 Jun 17 07:23:43.817664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 274/563] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:43 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:43.822853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a68d362e-9a37-457e-ac59-499929fd9a7d req-7e112918-146a-41ee-a405-0f45fd4e0fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:43.832592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a68d362e-9a37-457e-ac59-499929fd9a7d req-7e112918-146a-41ee-a405-0f45fd4e0fcb service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.833235 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a68d362e-9a37-457e-ac59-499929fd9a7d req-7e112918-146a-41ee-a405-0f45fd4e0fcb service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.847362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a68d362e-9a37-457e-ac59-499929fd9a7d req-7e112918-146a-41ee-a405-0f45fd4e0fcb service nova] Creating event network-changed:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:23:43.853511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a68d362e-9a37-457e-ac59-499929fd9a7d req-7e112918-146a-41ee-a405-0f45fd4e0fcb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034532 Jun 17 07:23:43.854371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 275/564] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:43.909745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:43.912918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:43.924195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.931242 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:43.932494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:43.933100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:44.053578 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-76f98009-a0fb-411b-a0f4-8586483fdabf tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "POST /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.374498 Jun 17 07:23:44.054642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 290/565] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:23:43 2022] POST /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:44.190626 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:44.198496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-46f14d21-cb19-426c-a384-81ed13afd3c7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.295934 Jun 17 07:23:44.199066 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 276/566] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:43 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:44.835236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:44.835937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:44.842707 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:44.843156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:44.843912 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:44.844370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:45.204196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:45.212296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6d88457b-214a-4bd1-8518-aceee39de330 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.381085 Jun 17 07:23:45.212850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 291/567] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:44 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:45.215867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:45.216502 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:45.223130 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:45.223583 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:45.224369 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:45.224829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:45.353190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:45.361115 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-462635ef-1b18-473e-89b0-bd8d01a9105e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.149652 Jun 17 07:23:45.361922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 277/568] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:45 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:46.228778 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:46.229379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:46.235897 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:46.236382 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:46.237145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:46.237590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:46.368868 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:46.376552 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-46812f70-6017-448c-9270-c05e15be8d2b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.151560 Jun 17 07:23:46.377130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 292/569] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:46 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:46.377830 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:46.378452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:46.385640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:46.386090 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:46.386860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:46.387301 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:46.516672 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:46.524954 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-107d239a-67a8-4f4e-b6ff-e48bbe9ad26d tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1735 microversion: 2.1 time: 0.150864 Jun 17 07:23:46.525059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 278/570] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:46 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:47.393937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:47.394544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:47.402525 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.402970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.403722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.404178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.539360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:47.542132 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:47.542742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:47.547179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-794bb7cc-44b7-44bd-9f4c-eef246a3fc61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1675 microversion: 2.1 time: 0.157028 Jun 17 07:23:47.547742 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 293/571] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:47 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:47.549392 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.549853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.550625 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.551064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.677263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:47.685171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d6f1abf4-34a4-4931-bd5c-3fef363044bb tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1715 microversion: 2.1 time: 0.147120 Jun 17 07:23:47.685730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 279/572] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:47 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:23:47.788811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:47.789350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:47.795596 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.796032 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.796810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.797238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.875584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] HTTP exception thrown: Cannot 'detach_volume' instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 while it is in vm_state rescued Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Request method failure captured: Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments/dced1ad2-89c7-4165-b73c-23a2f804b8c4 HTTP/1.1 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCscJCyreH5VH1x6U-gcUfpCNMF94Gukf8B1SqdB3M-TpmI9QAKJpH2k_r2ih9mvGlvgdtXO1R1G4fgffNI4JGTaFv1wfc5jyq8p9i1waO3Q1uXKHqJqqSM0zkbOk0yJxzo3kPqR3mD3MwjdS-G3hZKKiWyI1hoQqcDEisCjZKUWi1E Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:23:47.877312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: c11f44eb67cd4923a840171833bb572a Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:23:47.879054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Cannot 'detach_volume' instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 while it is in vm_state rescued Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'server_id': '76b63dc8-cc11-45bc-9017-47ddc80690e1', 'id': 'dced1ad2-89c7-4165-b73c-23a2f804b8c4'} Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:23:47.879824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 while it is in vm_state rescued Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 while it is in vm_state rescued Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:23:47.881302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Returning 409 to user: Cannot 'detach_volume' instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 while it is in vm_state rescued {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:23:47.882475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-254de28a-3e10-41ba-bd06-b135acd620bf tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments/dced1ad2-89c7-4165-b73c-23a2f804b8c4" status: 409 len: 152 microversion: 2.1 time: 0.093837 Jun 17 07:23:47.882475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 294/573] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:23:47 2022] DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments/dced1ad2-89c7-4165-b73c-23a2f804b8c4 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 07:23:47.888143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:47.888669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:47.894588 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.895029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.895799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.896256 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.961789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-677d219b-4b04-4f90-9c1a-122efb2ac0da tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/action" status: 202 len: 0 microversion: 2.1 time: 0.077275 Jun 17 07:23:47.965379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 280/574] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:23:47 2022] POST /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:23:47.970356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:47.970959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:47.977068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.977514 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:47.978271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:47.978715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:48.109399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:48.117343 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c807eecb-7afa-4a8f-b9e4-73d229019084 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1723 microversion: 2.1 time: 0.150768 Jun 17 07:23:48.118444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 295/575] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:47 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:48.564674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:48.565416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:48.571578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:48.572052 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:48.572838 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:48.573317 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:48.783497 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:48.791267 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ebe17f90-9463-4de4-be0c-be0f1d78c65d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1652 microversion: 2.1 time: 0.231070 Jun 17 07:23:48.791807 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 281/576] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:48 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1652 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:48.809686 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-96f9af0f-f36f-48a8-9cba-a32656dc9401 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:48.816314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96f9af0f-f36f-48a8-9cba-a32656dc9401 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:48.816704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-96f9af0f-f36f-48a8-9cba-a32656dc9401 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:48.876017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-96f9af0f-f36f-48a8-9cba-a32656dc9401 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Going to try to start instance {{(pid=117396) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 07:23:48.880481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:23:48.921547 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-96f9af0f-f36f-48a8-9cba-a32656dc9401 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action" status: 202 len: 0 microversion: 2.1 time: 0.116147 Jun 17 07:23:48.925337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 296/577] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:23:48 2022] POST /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:23:48.931213 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:48.931827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:48.937835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:48.938298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:48.939062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:48.939521 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:49.070174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:49.077664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ddf4d325-cd53-4d39-a976-35ed708e3640 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1661 microversion: 2.1 time: 0.150792 Jun 17 07:23:49.078241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 282/578] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:48 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:49.135796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:49.136529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:49.142630 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:49.143083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:49.143843 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:49.144310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:49.269725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:49.278440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-26796d73-489b-4e16-b8b1-703f0975662b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1723 microversion: 2.1 time: 0.147427 Jun 17 07:23:49.279002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 297/579] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:49 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:50.094719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:50.095331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:50.101876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:50.102329 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:50.103139 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:50.103528 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:50.233717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:50.241169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7e149abc-05ca-460f-ae11-f7ae292c3c61 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1661 microversion: 2.1 time: 0.150330 Jun 17 07:23:50.241731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 283/580] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:50 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:50.296589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:50.297154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:50.303573 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:50.304022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:50.304794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:50.305223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:50.441467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:50.449836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c85285a0-3905-4651-b1ab-051590dbc079 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1723 microversion: 2.1 time: 0.157149 Jun 17 07:23:50.450383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 298/581] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:50 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:51.258235 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:51.258872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:51.265406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:51.265853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:51.266610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:51.267046 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:51.401603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:51.409089 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e74f17ce-5dbd-4bd1-b9cf-c61d11c71228 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1661 microversion: 2.1 time: 0.154744 Jun 17 07:23:51.409645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 284/582] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:51 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:51.467200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:51.468021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:51.474587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:51.475159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:51.475901 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:51.476399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:51.604996 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:51.613090 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9afb6cb3-3de4-4846-bc60-0ffc16569e13 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1723 microversion: 2.1 time: 0.150241 Jun 17 07:23:51.613652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 299/583] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:51 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:52.426723 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:52.427341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:52.434408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.434860 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.435615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.436050 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.576824 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:52.584373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c69bca0d-e4b3-4ef9-910f-3388f50b7e55 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1661 microversion: 2.1 time: 0.161574 Jun 17 07:23:52.584936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 285/584] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:52 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:52.630243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:52.630848 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:52.637960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.638403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.639207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.639684 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.764855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:52.772926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e181524b-2f83-44b1-a630-c68976466406 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1729 microversion: 2.1 time: 0.146567 Jun 17 07:23:52.773489 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 300/585] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:52 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:52.790187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:52.790677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:52.797107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.797559 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.798320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:52.798759 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:52.876427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1a0ffc19-4e9c-468c-8df2-c95d2b813d64 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090822 Jun 17 07:23:52.877023 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 286/586] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:23:52 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:53.601377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:23:53.602473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:23:53.608488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:53.608934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:53.609697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:53.610129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:53.748786 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-6165f4da-4f4a-470f-9b0e-5845a129a8ea req-8d636dbf-e08e-4e87-89c3-aeb20855a92e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:53.759267 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6165f4da-4f4a-470f-9b0e-5845a129a8ea req-8d636dbf-e08e-4e87-89c3-aeb20855a92e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:53.760645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6165f4da-4f4a-470f-9b0e-5845a129a8ea req-8d636dbf-e08e-4e87-89c3-aeb20855a92e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:53.777957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-6165f4da-4f4a-470f-9b0e-5845a129a8ea req-8d636dbf-e08e-4e87-89c3-aeb20855a92e service nova] Creating event network-changed:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:23:53.793948 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-6165f4da-4f4a-470f-9b0e-5845a129a8ea req-8d636dbf-e08e-4e87-89c3-aeb20855a92e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048827 Jun 17 07:23:53.794866 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 287/587] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:23:53.811897 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:23:53.819525 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-df58ae27-12df-4197-89a8-df34a2dbc27b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1665 microversion: 2.1 time: 0.222068 Jun 17 07:23:53.820117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 301/588] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:23:53 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1665 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:23:55.810435 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a60842f0-5b0c-410e-9826-486944bc5723 req-34d9960e-0b19-4aa8-b1f6-d56eaa4a1301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:23:55.819169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a60842f0-5b0c-410e-9826-486944bc5723 req-34d9960e-0b19-4aa8-b1f6-d56eaa4a1301 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:23:55.819607 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a60842f0-5b0c-410e-9826-486944bc5723 req-34d9960e-0b19-4aa8-b1f6-d56eaa4a1301 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:23:55.831079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a60842f0-5b0c-410e-9826-486944bc5723 req-34d9960e-0b19-4aa8-b1f6-d56eaa4a1301 service nova] Creating event network-changed:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:23:55.837331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a60842f0-5b0c-410e-9826-486944bc5723 req-34d9960e-0b19-4aa8-b1f6-d56eaa4a1301 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 Jun 17 07:23:55.837937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 288/589] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:24:06.504007 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:06.504539 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:06.507207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=27 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:06.508010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:06.514100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:06.514547 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:06.515348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:06.515783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:06.594845 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lazy-loading 'services' on Instance uuid e46be2cb-9619-4e9e-972c-e9fc1a1939f9 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:24:06.665958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-22724654-b0c3-4923-a43b-0289b0c773bd tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9/os-volume_attachments/fa2b1751-1a24-485a-ae35-dc89517cc2e9" status: 202 len: 0 microversion: 2.1 time: 0.165797 Jun 17 07:24:06.666849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 302/590] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:24:06 2022] DELETE /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9/os-volume_attachments/fa2b1751-1a24-485a-ae35-dc89517cc2e9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:24:07.774161 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=61 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:07.774913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:07.779248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:07.779830 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:07.787284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:07.787733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:07.788517 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:07.788954 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:07.815027 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:24:07.890908 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b7d983fb-cfe5-4ed2-9bc2-925a06f67c1f tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 204 len: 0 microversion: 2.1 time: 0.118106 Jun 17 07:24:07.891444 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 289/591] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:24:07 2022] DELETE /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:24:07.900860 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:07.901554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:07.907832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:07.908314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:07.909067 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:07.909497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:08.038611 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:08.046993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ea83bfe4-8ac7-450e-952e-7f4561eb2a17 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1514 microversion: 2.1 time: 0.150981 Jun 17 07:24:08.047557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 303/592] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:07 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:09.065148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:09.065843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:09.072250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:09.072694 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:09.073439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:09.073868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:09.200939 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:09.208361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6472f695-60e1-4536-a454-dfde21523aa0 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1514 microversion: 2.1 time: 0.148000 Jun 17 07:24:09.208917 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 290/593] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:09 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:10.225263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:10.225869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:10.232422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:10.232867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:10.233623 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:10.234054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:10.375145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7615cf807ce746ada15efa0ff1cb80d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a5393056b74f1e871bb50775a40554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:10.383636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4f02c47b-0528-4d50-b96e-5084a90722e2 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 200 len: 1514 microversion: 2.1 time: 0.162204 Jun 17 07:24:10.384610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 304/594] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:10 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:10.797576 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-7f2c991b-c4d5-4ead-9e78-03bf015dc8d0 req-a549bfd0-f764-46be-87c0-b878540fd308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e46be2cb-9619-4e9e-972c-e9fc1a1939f9", "name": "network-vif-deleted", "tag": "9775ad68-7c70-469e-904b-93b7d670e84e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:10.808880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-7f2c991b-c4d5-4ead-9e78-03bf015dc8d0 req-a549bfd0-f764-46be-87c0-b878540fd308 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:10.809322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-7f2c991b-c4d5-4ead-9e78-03bf015dc8d0 req-a549bfd0-f764-46be-87c0-b878540fd308 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:10.821782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-7f2c991b-c4d5-4ead-9e78-03bf015dc8d0 req-a549bfd0-f764-46be-87c0-b878540fd308 service nova] Creating event network-vif-deleted:9775ad68-7c70-469e-904b-93b7d670e84e for instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 on hv-cinder-83482 Jun 17 07:24:10.828288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-7f2c991b-c4d5-4ead-9e78-03bf015dc8d0 req-a549bfd0-f764-46be-87c0-b878540fd308 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Jun 17 07:24:10.828886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 291/595] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:11.401794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:11.402466 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] [instance: e46be2cb-9619-4e9e-972c-e9fc1a1939f9] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:11.409633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:11.410114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:11.411063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:11.411659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:11.427536 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] HTTP exception thrown: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Request method failure captured: Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 HTTP/1.1 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCuZk4W6mdPgmA3z0W6CgmUhZzlo20qFDJ52V9V8x3rR-usEj1xKrTVv3B4kb9M_D9pJx915KtLr02mceIHINm0E05HNOlNEusHcqV_PPeGHnG0kqdlWSuNW5CzhCjmaMWs7lvMaKLLynuU23ocCnhDuwQobjEyRIOU7h4jF61wwc4I Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 71a5393056b74f1e871bb50775a40554 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:24:11.429239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71a5393056b74f1e871bb50775a40554"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71a5393056b74f1e871bb50775a40554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71a5393056b74f1e871bb50775a40554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71a5393056b74f1e871bb50775a40554"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 71a5393056b74f1e871bb50775a40554 Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-68639704 Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesSnapshotTestJSON-68639704-project Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 7615cf807ce746ada15efa0ff1cb80d7 Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesSnapshotTestJSON-68639704-project Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. Jun 17 07:24:11.430783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'e46be2cb-9619-4e9e-972c-e9fc1a1939f9'} Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:24:11.431568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. Jun 17 07:24:11.432796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:11.434441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] Returning 404 to user: Instance e46be2cb-9619-4e9e-972c-e9fc1a1939f9 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:24:11.434441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b7d26614-47b8-4d04-9225-23ebd4844628 tempest-VolumesSnapshotTestJSON-68639704 tempest-VolumesSnapshotTestJSON-68639704-project] 10.222.0.33 "GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9" status: 404 len: 111 microversion: 2.1 time: 0.033611 Jun 17 07:24:11.434441 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 305/596] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:11 2022] GET /compute/v2.1/servers/e46be2cb-9619-4e9e-972c-e9fc1a1939f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:24:19.001146 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:19.001755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:19.008588 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.009031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.009779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.010207 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.038765 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5dd60f44-f48b-4d5f-bb39-79641a9d9143 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments/52a45987-a7c8-44d7-826e-0cdd55be5869" status: 200 len: 194 microversion: 2.20 time: 0.041957 Jun 17 07:24:19.039332 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 292/597] 10.222.0.33 () {60 vars in 1453 bytes} [Fri Jun 17 07:24:18 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments/52a45987-a7c8-44d7-826e-0cdd55be5869 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:24:19.100631 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:19.101138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:19.107790 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.108282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.109040 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.109474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.189887 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lazy-loading 'services' on Instance uuid 029b110f-b393-4f26-a564-bc4c10ce744b {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:24:19.259803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b90dafd9-4515-415d-a06f-548e0db4cb55 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments/52a45987-a7c8-44d7-826e-0cdd55be5869" status: 202 len: 0 microversion: 2.20 time: 0.162885 Jun 17 07:24:19.260408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 306/598] 10.222.0.33 () {60 vars in 1456 bytes} [Fri Jun 17 07:24:19 2022] DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments/52a45987-a7c8-44d7-826e-0cdd55be5869 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:24:19.268755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:19.269678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:19.276509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.276965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.277890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:19.278324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:19.310779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f0dd2d8f-0c28-4b88-bdb5-b23a0dcb4c52 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045931 Jun 17 07:24:19.311336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 293/599] 10.222.0.33 () {60 vars in 1342 bytes} [Fri Jun 17 07:24:19 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:24:20.290454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:20.291558 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:20.298802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.299252 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.300024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.300491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.326855 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:20.328832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:20.338121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.338720 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.339582 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.340164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.392397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4eab8a52-ccbc-4142-9ef1-38e1d0bf5067 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action" status: 202 len: 0 microversion: 2.1 time: 0.106482 Jun 17 07:24:20.395925 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 307/600] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:24:20 2022] POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:24:20.403738 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-54680125-c45c-4df6-9cf5-6d93ed7c3369 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084485 Jun 17 07:24:20.405326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:20.405808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:20.407959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 294/601] 10.222.0.33 () {60 vars in 1342 bytes} [Fri Jun 17 07:24:20 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:24:20.418324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.418776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.419616 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:20.420083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:20.579837 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:20.587749 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-842d9dbf-49e4-4c6c-b691-1f5e777c35a0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1751 microversion: 2.1 time: 0.187658 Jun 17 07:24:20.588344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 308/602] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:20 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:21.420333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:21.421289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:21.428895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.429348 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.430113 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.430545 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.461534 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-338ad10d-9d8d-42da-9001-6bb218fe2468 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045521 Jun 17 07:24:21.462096 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 295/603] 10.222.0.33 () {60 vars in 1342 bytes} [Fri Jun 17 07:24:21 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:21.520331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:21.520833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:21.527392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.527836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.528691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.529092 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.554025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:24:21.605626 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:21.606271 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:21.613125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.613579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.614351 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.614853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.630761 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2f1380ff-2c92-4f3e-b4e9-4dee2f0a9139 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 204 len: 0 microversion: 2.20 time: 0.114033 Jun 17 07:24:21.631729 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 309/604] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Jun 17 07:24:21 2022] DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:24:21.640393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:21.641082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:21.647087 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.647532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.648356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:21.648788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:21.758740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:21.766871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-426d00f3-e9c3-4d4f-bdc2-a8e55d4f2907 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.165205 Jun 17 07:24:21.767439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 296/605] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:21 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:21.777661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:21.786134 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:21.787621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:21.789373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-daa8c080-4941-4458-bb46-5a23988312d0 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.152636 Jun 17 07:24:21.789937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 310/606] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:21 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:22.784492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:22.785110 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:22.791558 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:22.792292 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:22.793037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:22.793467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:22.808048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:22.808680 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:22.815105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:22.815550 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:22.816329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:22.816765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:22.939327 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:22.946556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:22.947300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0635fe10-ea9e-4d4b-b5d3-9a5361691db3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.166639 Jun 17 07:24:22.947872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 297/607] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:22 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:22.955113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:22.956746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:22.957872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-efb87c4f-77c4-4f5a-a5f6-3b5dc6869459 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.153647 Jun 17 07:24:22.958407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 311/608] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:22 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:23.964650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:23.965261 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:23.972577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:23.973151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:23.973916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:23.974377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:23.975791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:23.976433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:23.982784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:23.983810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:23.984596 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:23.985030 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:24.111628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:24.113514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:24.119606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:24.121107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:24.121436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-40de0943-07a3-4ebb-bab8-5a5ff26d6d50 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.160623 Jun 17 07:24:24.121996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 298/609] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:23 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:24.122243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0f6ab29b-f47e-4604-9ca0-171253ecea8b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.150290 Jun 17 07:24:24.122853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 312/610] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:23 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:25.137557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:25.138168 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:25.139786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:25.140361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:25.144676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:25.145118 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:25.145872 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:25.146304 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:25.146685 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:25.147136 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:25.147890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:25.148350 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:25.281331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:25.289728 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:25.291288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:25.292730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-df02186c-4adc-42fa-9efd-1c3698df1886 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.156819 Jun 17 07:24:25.293477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 313/611] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:25 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:25.299494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:25.307586 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2368b78d-53d2-44e7-bef0-0d164df6412e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.173872 Jun 17 07:24:25.308331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 299/612] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:25 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:26.310848 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:26.312116 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:26.318435 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:26.318884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:26.319639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:26.320087 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:26.324297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:26.324916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:26.331284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:26.331736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:26.332526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:26.332967 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:26.447932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:26.455998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:26.457561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:26.458710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4401faf8-2453-40ff-b8a5-0aaee5259d9d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1724 microversion: 2.20 time: 0.151881 Jun 17 07:24:26.459266 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 314/613] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:26 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:26.473878 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:26.481812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bf9d372d-51ec-45e9-b780-9086f9c9b319 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.161368 Jun 17 07:24:26.482423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 300/614] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:26 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:27.476022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:27.476656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:27.483127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:27.483575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:27.484373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:27.484808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:27.488988 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:27.499214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:27.499832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:27.506604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:27.507362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:27.508341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:27.508952 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:27.553673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:27.562889 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:27.564550 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:27.565786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-46e8d574-c8e6-45a1-8b03-f6f2ca33ee92 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 200 len: 1656 microversion: 2.20 time: 0.093689 Jun 17 07:24:27.566594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 315/615] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:27 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:27.671653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-5252f873-8820-4978-8e3c-6c616137b48a req-f748e1b6-d8ec-4bde-b1dc-e29c5c3fb936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "029b110f-b393-4f26-a564-bc4c10ce744b", "name": "network-vif-deleted", "tag": "64a7d8d8-05dd-4a53-a5a0-14ec44851533"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:27.684188 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-5252f873-8820-4978-8e3c-6c616137b48a req-f748e1b6-d8ec-4bde-b1dc-e29c5c3fb936 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:27.684995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-5252f873-8820-4978-8e3c-6c616137b48a req-f748e1b6-d8ec-4bde-b1dc-e29c5c3fb936 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:27.698057 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-5252f873-8820-4978-8e3c-6c616137b48a req-f748e1b6-d8ec-4bde-b1dc-e29c5c3fb936 service nova] Creating event network-vif-deleted:64a7d8d8-05dd-4a53-a5a0-14ec44851533 for instance 029b110f-b393-4f26-a564-bc4c10ce744b on hv-cinder-83482 Jun 17 07:24:27.704828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-5252f873-8820-4978-8e3c-6c616137b48a req-f748e1b6-d8ec-4bde-b1dc-e29c5c3fb936 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Jun 17 07:24:27.705741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 316/616] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:24:27.717539 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:27.729171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-775806d6-035c-4ea9-90a5-cf3d608b5376 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.233774 Jun 17 07:24:27.739513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 301/617] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:27 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:28.585193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:28.585902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:28.592284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:28.592803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:28.593579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:28.594016 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:28.607472 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b HTTP/1.1 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:24:28.609702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:24:28.611455 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '029b110f-b393-4f26-a564-bc4c10ce744b'} Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:24:28.612713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:24:28.614248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:24:28.616767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:24:28.616767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e477e438-8f5f-4e3d-81ae-0d0b598dc031 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 404 len: 111 microversion: 2.20 time: 0.030822 Jun 17 07:24:28.619769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5137fa60-ee2c-4e17-b151-35315ef26330 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '.version_select at 0x7f8b6d38bee0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:28.623436 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 317/618] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:28 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:24:28.639911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5137fa60-ee2c-4e17-b151-35315ef26330 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372414217" status: 204 len: 0 microversion: 2.20 time: 0.023803 Jun 17 07:24:28.640778 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 302/619] 10.222.0.33 () {60 vars in 1261 bytes} [Fri Jun 17 07:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372414217 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:24:28.747127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:28.747969 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:28.754935 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:28.755507 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:28.756496 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:28.756959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:28.941133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:28.950602 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d9bbc803-fafc-49bb-8805-34d6e6c4500e tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.207363 Jun 17 07:24:28.951358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 318/620] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:28 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:29.329973 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-9ced2353-9e45-4c96-9e98-fbc3c5463f50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: .version_select at 0x7f8b6d2dd1f0>, body: {"keypair": {"name": "tempest-keypair-2030533923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqyMGVRjaPPis360LXHJe3JXG1oeJp0QdU/5bL7Eb2K3yg3DmbSlheYe6RyV/B2K6+A8B5IwSNJ1wE+sgtdSWschOC24xi3ubkWmE0rJUzhkRWHkyopEtkXeOzfeA9dyg=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:29.345281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-9ced2353-9e45-4c96-9e98-fbc3c5463f50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for project 277f81ef9ed74a6189221440edd53d4c. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:24:29.349165 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-9ced2353-9e45-4c96-9e98-fbc3c5463f50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for user 31e94cc1c6a743ce898424ad7ba26cf1 and project 277f81ef9ed74a6189221440edd53d4c. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:24:29.371069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-9ced2353-9e45-4c96-9e98-fbc3c5463f50 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045701 Jun 17 07:24:29.371661 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 303/621] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Jun 17 07:24:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 07:24:29.968542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:29.969152 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:29.975619 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:29.976085 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:29.976863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:29.977283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:30.136722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:30.148569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-712d7fdb-0a79-4712-8f9c-1382ab3b36dc tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.183435 Jun 17 07:24:30.148569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 319/622] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:29 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:30.661914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-204444214", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed70ad4c-5186-4d7f-a1ab-3e0db877b874"}], "security_groups": [{"name": "tempest-securitygroup--940155613"}], "key_name": "tempest-keypair-2030533923", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:30.761743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] validate_networks() for [('ed70ad4c-5186-4d7f-a1ab-3e0db877b874', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:24:31.118172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:24:31.118603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:24:31.119079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:24:31.119490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:24:31.119903 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:24:31.128796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:31.129250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:31.130049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:31.130487 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:31.147071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for project 277f81ef9ed74a6189221440edd53d4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:24:31.150951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Getting quotas for user 31e94cc1c6a743ce898424ad7ba26cf1 and project 277f81ef9ed74a6189221440edd53d4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:24:31.162567 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:24:31.164847 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:24:31.165759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:31.166363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:31.173358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:31.173872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:31.174827 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:31.175323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:31.212852 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-effaae88-2821-49a7-a999-2ae57e683ff5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.555704 Jun 17 07:24:31.213707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 304/623] 10.222.0.33 () {62 vars in 1187 bytes} [Fri Jun 17 07:24:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 07:24:31.223164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:31.223772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:31.279961 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:31.290575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:31.292845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:31.294409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c05dcfe8-f9d4-4152-af7f-0b1fa51c6eb9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1281 microversion: 2.20 time: 0.074743 Jun 17 07:24:31.295371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 305/624] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:31 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:31.385466 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:31.398452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-64b8f057-ab63-4204-a0b4-706a39375695 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.236389 Jun 17 07:24:31.399114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 320/625] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:31 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:32.313292 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:32.314592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:32.321596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:32.322117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:32.322934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:32.323425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:32.415128 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:32.419481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:32.427570 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:32.428041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:32.429083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:32.429652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:32.430582 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:32.446158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:32.448929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:32.450889 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cb846268-aa4b-4c32-b275-8764ebf6fbff tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1339 microversion: 2.20 time: 0.142072 Jun 17 07:24:32.453226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 306/626] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:32 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1339 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:32.601248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:32.610011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0471c0bd-b1af-4173-8423-b9993aae29c4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.199216 Jun 17 07:24:32.610629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 321/627] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:32 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:33.468990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:33.469593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:33.476409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:33.476845 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:33.477888 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:33.478401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:33.627361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:33.628038 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:33.634779 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:33.635309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:33.636247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:33.636753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:33.718518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:33.745747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:33.757124 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:33.760877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-27d7fa8a-9079-4e6a-8093-b9c9f1e27bd7 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.295756 Jun 17 07:24:33.767145 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 307/628] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:33 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:33.772493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-82fccdf5-a131-42dd-aef9-d3c4c72ff738 req-db9f0d72-b8fe-43f3-8494-b5825e40c732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:33.790947 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-82fccdf5-a131-42dd-aef9-d3c4c72ff738 req-db9f0d72-b8fe-43f3-8494-b5825e40c732 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:33.791470 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-82fccdf5-a131-42dd-aef9-d3c4c72ff738 req-db9f0d72-b8fe-43f3-8494-b5825e40c732 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:33.800698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:33.812557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-82fccdf5-a131-42dd-aef9-d3c4c72ff738 req-db9f0d72-b8fe-43f3-8494-b5825e40c732 service nova] Creating event network-changed:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:24:33.826504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-82fccdf5-a131-42dd-aef9-d3c4c72ff738 req-db9f0d72-b8fe-43f3-8494-b5825e40c732 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057631 Jun 17 07:24:33.827482 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 308/629] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:33.901286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:33.910315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9f64018e-4dc4-443e-870b-d81364f86057 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.287309 Jun 17 07:24:33.911172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 322/630] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:33 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:34.784936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:34.785633 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:34.793534 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:34.793981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:34.794736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:34.795172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:34.924657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:34.928629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:34.929241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:34.932868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:34.934373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:34.935745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b8be3263-9543-4ed1-9157-39fd57bb2066 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.155222 Jun 17 07:24:34.935863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:34.945911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:34.946225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 309/631] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:34 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:24:34.946347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:34.946347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:35.119070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:35.127195 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fa67ac0b-1372-446e-92b6-a200e5e14983 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.202477 Jun 17 07:24:35.127767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 323/632] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:34 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:35.954049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:35.954751 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:35.961367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:35.961822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:35.962598 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:35.963038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:36.093299 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:36.101277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:36.102758 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:36.104010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7ef446fc-fe50-4f4f-93bb-5bb5d13d3f4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.154441 Jun 17 07:24:36.104591 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 310/633] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:35 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:36.144571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:36.145179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:36.151926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:36.152413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:36.153180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:36.153613 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:36.298647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:36.306716 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2527cf7d-4648-4ea0-bea9-19a650c45cfa tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.166208 Jun 17 07:24:36.307291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 324/634] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:36 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:37.121846 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:37.122456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:37.128999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:37.129445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:37.130201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:37.130646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:37.258495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:37.267221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:37.268745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:37.269844 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d27b3cb1-456d-461b-b6f4-fe69703ccbe4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.151925 Jun 17 07:24:37.270405 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 311/635] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:37 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:37.325876 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:37.326943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:37.330127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:37.335920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:37.336390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:37.337144 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:37.337573 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:37.483288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:37.491221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-70e708e5-a832-430a-8dd3-ae1dd515fd39 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.171035 Jun 17 07:24:37.491782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 325/636] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:37 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:38.289277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:38.289893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:38.292661 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:38.299181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:38.299633 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:38.300435 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:38.300880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:38.508622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:38.509231 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:38.515893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:38.516397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:38.517163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:38.517596 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:38.599402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:38.609051 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:38.610855 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:38.612264 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aa73b9f0-145f-4786-bbe8-6c7522030bb2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.327193 Jun 17 07:24:38.612828 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 312/637] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:38 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:38.669244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:38.677773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ef792127-de25-4c2c-bb59-11462fd02554 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.173029 Jun 17 07:24:38.678341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 326/638] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:38 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:39.630069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:39.630645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:39.637340 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:39.637789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:39.638580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:39.639013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:39.694669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:39.695272 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:39.701731 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:39.702685 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:39.703436 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:39.703870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:39.772020 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:39.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:39.781899 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:39.783045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-14b424b7-8549-431c-bff5-bfe3c7cd1414 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.156921 Jun 17 07:24:39.783614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 313/639] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:39 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:39.902312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:39.910247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-80ca4b1e-0aad-429a-bf45-cde4ce885755 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.219488 Jun 17 07:24:39.910816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 327/640] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:39 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:40.801842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:40.802444 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:40.808718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:40.809164 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:40.809915 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:40.810348 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:40.927185 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:40.927939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:40.934600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:40.935048 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:40.935656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:40.935817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:40.936290 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:40.943783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:40.945296 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:40.946380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2bd7581a-0c51-4bd1-8f10-0121966c5d29 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.148512 Jun 17 07:24:40.946931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 314/641] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:40 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:41.072312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:41.080313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-56455a2d-3c47-4667-9967-240f40c0513d tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1756 microversion: 2.1 time: 0.156976 Jun 17 07:24:41.080881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 328/642] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:40 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:41.874304 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-995b145c-5086-4c75-9602-9bf4c624d5e8 req-04ed6ce8-c46a-40c9-8db5-a52f4121c827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "name": "network-vif-plugged", "status": "completed", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:41.877748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:41.878587 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=12 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:41.885380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-995b145c-5086-4c75-9602-9bf4c624d5e8 req-04ed6ce8-c46a-40c9-8db5-a52f4121c827 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:41.885829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-995b145c-5086-4c75-9602-9bf4c624d5e8 req-04ed6ce8-c46a-40c9-8db5-a52f4121c827 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:41.898683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-995b145c-5086-4c75-9602-9bf4c624d5e8 req-04ed6ce8-c46a-40c9-8db5-a52f4121c827 service nova] Creating event network-vif-plugged:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:24:41.903605 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-995b145c-5086-4c75-9602-9bf4c624d5e8 req-04ed6ce8-c46a-40c9-8db5-a52f4121c827 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Jun 17 07:24:41.904215 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 315/643] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:41.964628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:41.965245 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:41.972932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:41.973483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:41.974481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:41.974984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:42.097884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:42.098829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:42.105551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:42.106006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:42.106776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:42.107209 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:42.108778 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:42.119231 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:42.120478 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:42.121735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-656f2a9b-2d63-47b4-a3ed-1a3ffb1dce36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.161441 Jun 17 07:24:42.122551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 329/644] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:41 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:42.509096 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:42.516917 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8a94735a-222f-4bac-82e6-72bb7f80e56a tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1759 microversion: 2.1 time: 0.423431 Jun 17 07:24:42.517478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 316/645] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:42 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1759 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:43.140109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:43.140730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:43.148360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.148875 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.149662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.150101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.197319 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:43.197857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:43.204463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.205095 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.206045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.206760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.288671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:43.295446 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'services' on Instance uuid 76b63dc8-cc11-45bc-9017-47ddc80690e1 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:24:43.297628 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:43.299135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:43.300282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3f7ed0b4-def1-433e-9471-6222cdc8ff5f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1406 microversion: 2.20 time: 0.164262 Jun 17 07:24:43.301395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 330/646] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:43 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:43.368445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-70171cce-5950-46b5-bc36-a6c427a207df tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments/dced1ad2-89c7-4165-b73c-23a2f804b8c4" status: 202 len: 0 microversion: 2.1 time: 0.175033 Jun 17 07:24:43.369216 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 317/647] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:24:43 2022] DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments/dced1ad2-89c7-4165-b73c-23a2f804b8c4 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:24:43.379850 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:43.380904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:43.387685 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.388401 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.389278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:43.389712 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:43.424878 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-246b9434-4c21-457e-bf3d-0909bf550816 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050839 Jun 17 07:24:43.426163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 331/648] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:43 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:44.318787 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.319554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.326737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.327195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.327964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.328436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.438226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.439553 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.448135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.448677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.449739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.450247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.468934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:44.476960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:44.478453 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:44.479603 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-535fbc3f-31ba-446b-988e-7d7a08826596 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1598 microversion: 2.20 time: 0.165035 Jun 17 07:24:44.480179 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 318/649] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:24:44 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:24:44.480803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-05731d02-fc07-4e63-a54e-d75348841bd9 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047580 Jun 17 07:24:44.485082 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 332/650] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:44 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:44.485225 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.486152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.493006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.493462 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.494445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.494892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.497926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.498413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.505285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.505732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.506488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.506919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.510744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:44.528167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-17987bc7-bf0b-43ba-861b-1299faf0218a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046862 Jun 17 07:24:44.528746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 319/651] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:44 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:24:44.591272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.591823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.598245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.598668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.599433 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.599871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.600395 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-125a6142-1a4d-4ea0-afb5-839526a8022b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106380 Jun 17 07:24:44.601608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 333/652] 10.222.0.33 () {60 vars in 1315 bytes} [Fri Jun 17 07:24:44 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 07:24:44.626079 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:24:44.715336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6a2f73b7-5917-4374-9be3-2ef5d59ea3dd tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 204 len: 0 microversion: 2.1 time: 0.127511 Jun 17 07:24:44.716129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 320/653] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:24:44 2022] DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:24:44.728587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:44.729939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:44.737251 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.737981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.738950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:44.739495 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:44.901929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:44.911819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c902bc13-650b-4ed6-ade5-a34856af2834 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1671 microversion: 2.1 time: 0.191287 Jun 17 07:24:44.913149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 334/654] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:44 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:45.495346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:45.496439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:45.503420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:45.503871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:45.504704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:45.505135 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:45.538492 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f46a5ec8-9177-4fa0-98b0-bc1df12c33c1 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049111 Jun 17 07:24:45.539085 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 321/655] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:45 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:45.648354 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-3dab3021-54b0-4624-845d-2803bc37ef6e req-1356ce8c-5bdc-4705-9168-3dc111861182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:45.658130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3dab3021-54b0-4624-845d-2803bc37ef6e req-1356ce8c-5bdc-4705-9168-3dc111861182 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:45.658575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-3dab3021-54b0-4624-845d-2803bc37ef6e req-1356ce8c-5bdc-4705-9168-3dc111861182 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:45.671882 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-3dab3021-54b0-4624-845d-2803bc37ef6e req-1356ce8c-5bdc-4705-9168-3dc111861182 service nova] Creating event network-changed:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:24:45.677145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-3dab3021-54b0-4624-845d-2803bc37ef6e req-1356ce8c-5bdc-4705-9168-3dc111861182 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 Jun 17 07:24:45.677739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 335/656] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:45.931123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:45.931771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:45.938187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:45.938638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:45.939414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:45.939854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:46.070823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:46.078737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5a74790a-5f14-496d-a4d6-e14fa60a9ce5 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1671 microversion: 2.1 time: 0.151566 Jun 17 07:24:46.079295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 322/657] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:45 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:46.551693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:46.552799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:46.559609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:46.560320 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:46.561920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:46.562528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:46.593542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-58a66ae4-485f-49bc-93e9-43d3aed382d2 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Jun 17 07:24:46.594122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 336/658] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:46 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:47.096253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:47.096981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:47.103874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.104354 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.105120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.105767 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.253070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:47.256564 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:24:47.261372 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7f63a978-e7eb-415c-9a3d-2551afc6b044 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1671 microversion: 2.1 time: 0.169677 Jun 17 07:24:47.261934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 323/659] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:47 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:47.605298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:47.606213 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:47.612770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.613220 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.613981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.614414 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.642902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3f69ac31-c7ec-4372-8f6b-90d4cefeeb79 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041569 Jun 17 07:24:47.643519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 337/660] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:24:47 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 17 07:24:47.711892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:47.712427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:47.719986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.720460 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.721221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.721657 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.746025 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:24:47.826298 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-eb43f6ec-12f2-475f-914d-b8e950bace2a tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 204 len: 0 microversion: 2.1 time: 0.119166 Jun 17 07:24:47.827942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 324/661] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:24:47 2022] DELETE /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:24:47.835853 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:47.836697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:47.842993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.843440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.844275 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:47.844705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:47.975145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:47.982741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9b719a3b-4510-4419-abd0-5066adc6b597 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1689 microversion: 2.1 time: 0.150738 Jun 17 07:24:47.983310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 338/662] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:47 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:48.279782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:48.280540 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:48.288900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:48.288900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:48.288900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:48.288900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:48.351236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-4a40d026-7a42-4227-9f12-db644bb19d31 req-174e3bcb-9715-46b7-8809-08a9bc4a893e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73a8c90c-c561-4193-8276-ae0351b550f4", "name": "network-vif-deleted", "tag": "b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:48.360374 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4a40d026-7a42-4227-9f12-db644bb19d31 req-174e3bcb-9715-46b7-8809-08a9bc4a893e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:48.360945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4a40d026-7a42-4227-9f12-db644bb19d31 req-174e3bcb-9715-46b7-8809-08a9bc4a893e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:48.369147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:48.372254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-4a40d026-7a42-4227-9f12-db644bb19d31 req-174e3bcb-9715-46b7-8809-08a9bc4a893e service nova] Creating event network-vif-deleted:b5405e73-90d6-4c18-ad7b-cfbd6f4aa34c for instance 73a8c90c-c561-4193-8276-ae0351b550f4 on hv-cinder-83482 Jun 17 07:24:48.377730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-4a40d026-7a42-4227-9f12-db644bb19d31 req-174e3bcb-9715-46b7-8809-08a9bc4a893e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030298 Jun 17 07:24:48.378484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-177084bf-cc8a-4a46-a339-944e50cc10cf tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1604 microversion: 2.1 time: 0.103158 Jun 17 07:24:48.378678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 339/663] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:24:48.379294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 325/664] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:48 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:49.001301 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:49.002024 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:49.008798 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:49.009244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:49.009999 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:49.010435 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:49.141632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:49.149312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-08ea3293-7d4d-4a7f-805f-bdb17b0c4c4b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1689 microversion: 2.1 time: 0.152655 Jun 17 07:24:49.149885 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 340/665] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:48 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:49.395772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:49.396405 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:49.403291 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:49.403737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:49.404519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:49.405018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:49.467975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:49.475490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3779c96a-ec19-4b03-9d36-f80b427bf82e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1604 microversion: 2.1 time: 0.083657 Jun 17 07:24:49.476049 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 326/666] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:49 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1604 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:50.166127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:50.166664 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:50.173890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:50.174334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:50.175080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:50.175507 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:50.303027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:50.310401 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c0521122-3043-4bc5-b7fc-e1ed2c1fb532 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1689 microversion: 2.1 time: 0.148192 Jun 17 07:24:50.310955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 341/667] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:50 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:50.491379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:50.491988 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:50.498585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:50.499043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:50.499798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:50.500271 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:50.559425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:50.566933 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1e5baa63-1a47-423f-8fb5-7d597f908875 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 200 len: 1604 microversion: 2.1 time: 0.079394 Jun 17 07:24:50.567490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 327/668] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:50 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 1604 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:51.326636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:51.327426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:51.334157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:51.334859 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:51.335625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:51.336080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:51.490721 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:51.499014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f9237537-130b-4308-8b0e-874be9846b2f tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1689 microversion: 2.1 time: 0.176046 Jun 17 07:24:51.499644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 342/669] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:51 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:51.584045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:51.584700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:51.591774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:51.592886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:51.593739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:51.594275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:51.609240 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 HTTP/1.1 Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:24:51.610914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:24:51.612459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '73a8c90c-c561-4193-8276-ae0351b550f4'} Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:24:51.613274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:24:51.614696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:51.615789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:24:51.615789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5077d058-61cf-42ce-a3fd-93833ffcda25 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 404 len: 111 microversion: 2.1 time: 0.032357 Jun 17 07:24:51.615789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 328/670] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:51 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:24:51.621858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0f35413e-ab7b-4922-a2db-f8e01c757cbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '.version_select at 0x7f8b6d4f4790>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:51.640558 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0f35413e-ab7b-4922-a2db-f8e01c757cbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124569093" status: 202 len: 0 microversion: 2.1 time: 0.021897 Jun 17 07:24:51.644551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 343/671] 10.222.0.33 () {58 vars in 1220 bytes} [Fri Jun 17 07:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124569093 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:24:52.249523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b03a3260-53e8-442b-8f65-78bfd0b03eb9 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: .version_select at 0x7f8b6d2f3c10>, body: {"keypair": {"name": "tempest-keypair-1476901575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfLkVWQrmmQ3f4hpAWqu+SsSwfnMaO+42bR3lvULdxIvFJgtlDHvyfBLnlKWpqEPuO2ZfKsPKrKZYibwyky33hIAK3Ks47h1LGo7UOGhjXrftexhm6sNxs9YtV2dY0tXg=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:52.263447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-b03a3260-53e8-442b-8f65-78bfd0b03eb9 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for project ab7deafed6f447faade3e3d8d281617a. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:24:52.267866 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-b03a3260-53e8-442b-8f65-78bfd0b03eb9 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for user b3ca63f8f8484ddf9d7c72749ba7f482 and project ab7deafed6f447faade3e3d8d281617a. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:24:52.289197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b03a3260-53e8-442b-8f65-78bfd0b03eb9 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044014 Jun 17 07:24:52.289958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 329/672] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:24:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:52.427267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-62f5590f-5dc2-4bfe-a0a5-b380af451911 req-368eb676-96a4-4d5b-a11f-383df0211fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76b63dc8-cc11-45bc-9017-47ddc80690e1", "name": "network-vif-deleted", "tag": "6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:52.437577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-62f5590f-5dc2-4bfe-a0a5-b380af451911 req-368eb676-96a4-4d5b-a11f-383df0211fc7 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:52.438092 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-62f5590f-5dc2-4bfe-a0a5-b380af451911 req-368eb676-96a4-4d5b-a11f-383df0211fc7 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:52.449587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-62f5590f-5dc2-4bfe-a0a5-b380af451911 req-368eb676-96a4-4d5b-a11f-383df0211fc7 service nova] Creating event network-vif-deleted:6d9bd6a7-b4e1-4f54-98b2-af51f606d3eb for instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 on hv-cinder-83482 Jun 17 07:24:52.455404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-62f5590f-5dc2-4bfe-a0a5-b380af451911 req-368eb676-96a4-4d5b-a11f-383df0211fc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032569 Jun 17 07:24:52.456403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 344/673] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:24:52.517819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:52.518436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:52.530013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:52.531038 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:52.531853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:52.532320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:52.568574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:52.569028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:52.569533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'fault' on Instance uuid 76b63dc8-cc11-45bc-9017-47ddc80690e1 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:24:52.634637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:52.645147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6280603f-ed21-4543-96a4-0fa192d8c6e5 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 200 len: 1336 microversion: 2.1 time: 0.132300 Jun 17 07:24:52.646228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 330/674] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:52 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:53.613702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-378988455", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1239213d-0a3b-407c-aa59-5c1ac224edf4"}], "security_groups": [{"name": "tempest-securitygroup--1312118718"}], "key_name": "tempest-keypair-1476901575", "user_data": "}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:53.662132 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:53.668158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 76b63dc8-cc11-45bc-9017-47ddc80690e1] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:53.675955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:53.676573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:53.677668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:53.678231 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:53.693209 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] HTTP exception thrown: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Request method failure captured: Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 HTTP/1.1 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCscJCyreH5VH1x6U-gcUfpCNMF94Gukf8B1SqdB3M-TpmI9QAKJpH2k_r2ih9mvGlvgdtXO1R1G4fgffNI4JGTaFv1wfc5jyq8p9i1waO3Q1uXKHqJqqSM0zkbOk0yJxzo3kPqR3mD3MwjdS-G3hZKKiWyI1hoQqcDEisCjZKUWi1E Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:24:53.694935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: c11f44eb67cd4923a840171833bb572a Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. Jun 17 07:24:53.696826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '76b63dc8-cc11-45bc-9017-47ddc80690e1'} Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:24:53.697684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. Jun 17 07:24:53.699219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:24:53.700555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Returning 404 to user: Instance 76b63dc8-cc11-45bc-9017-47ddc80690e1 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:24:53.700555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4ad1172a-5cbd-4073-acfd-c49c677c85fe tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1" status: 404 len: 111 microversion: 2.1 time: 0.038642 Jun 17 07:24:53.700835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 331/675] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:53 2022] GET /compute/v2.1/servers/76b63dc8-cc11-45bc-9017-47ddc80690e1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:24:53.705728 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-13979bd5-16f7-42c7-abaf-95c72c3460e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '.version_select at 0x7f8b6d6160d0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:53.724420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-13979bd5-16f7-42c7-abaf-95c72c3460e7 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062397064" status: 202 len: 0 microversion: 2.1 time: 0.022268 Jun 17 07:24:53.725000 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 332/676] 10.222.0.33 () {58 vars in 1220 bytes} [Fri Jun 17 07:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062397064 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:24:53.728231 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] validate_networks() for [('1239213d-0a3b-407c-aa59-5c1ac224edf4', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:24:54.177658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:24:54.178108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:24:54.178582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:24:54.178989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:24:54.179396 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:24:54.188293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:54.188743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:54.189544 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:54.189974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:54.207207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for project ab7deafed6f447faade3e3d8d281617a. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:24:54.211163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Getting quotas for user b3ca63f8f8484ddf9d7c72749ba7f482 and project ab7deafed6f447faade3e3d8d281617a. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:24:54.222796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:24:54.225202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:24:54.272635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0e5cf178-88b7-4c64-9704-4ebe28ef2524 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664491 Jun 17 07:24:54.273473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 345/677] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:24:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:24:54.283947 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-beb67ed2-8549-4f28-a647-931b0a482fbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:54.284496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-beb67ed2-8549-4f28-a647-931b0a482fbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:54.358271 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-beb67ed2-8549-4f28-a647-931b0a482fbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:54.366937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-beb67ed2-8549-4f28-a647-931b0a482fbe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1237 microversion: 2.1 time: 0.087214 Jun 17 07:24:54.367797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 333/678] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:54 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:55.384898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:55.386266 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:55.400091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:55.400766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:55.401858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:55.402452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:55.474234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:55.482667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-467d5883-e7b4-4f16-9e8a-7b06fe34f4f1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1297 microversion: 2.1 time: 0.102247 Jun 17 07:24:55.483287 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 346/679] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:55 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:56.500871 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:56.501489 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:56.508592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:56.509048 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:56.510012 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:56.510460 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:56.713246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:56.721412 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-859cc797-0d25-45a3-87fd-90860dc39a99 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.225098 Jun 17 07:24:56.721973 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 334/680] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:56 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:56.862368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-eb06aa9d-5aaa-4e6f-9c31-4cc0c3dff1d7 req-19340c94-6afd-468d-b4aa-08b2a5a27e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09501bed-6039-46fb-8dd3-6a6fba9865ed", "tag": "8ad0ac99-8aca-4f10-a23a-7c33706d11e5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:24:56.871306 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-eb06aa9d-5aaa-4e6f-9c31-4cc0c3dff1d7 req-19340c94-6afd-468d-b4aa-08b2a5a27e32 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:56.871759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-eb06aa9d-5aaa-4e6f-9c31-4cc0c3dff1d7 req-19340c94-6afd-468d-b4aa-08b2a5a27e32 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:56.890007 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-eb06aa9d-5aaa-4e6f-9c31-4cc0c3dff1d7 req-19340c94-6afd-468d-b4aa-08b2a5a27e32 service nova] Creating event network-changed:8ad0ac99-8aca-4f10-a23a-7c33706d11e5 for instance 09501bed-6039-46fb-8dd3-6a6fba9865ed on hv-cinder-83482 Jun 17 07:24:56.905413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-eb06aa9d-5aaa-4e6f-9c31-4cc0c3dff1d7 req-19340c94-6afd-468d-b4aa-08b2a5a27e32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046331 Jun 17 07:24:56.906375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 347/681] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:24:56.926142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:56.926717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:56.933497 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:56.934035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:56.934880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:56.935393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:56.962288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:24:57.051712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2954ac81-fd2e-43c2-920d-fe77824c11d0 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 204 len: 0 microversion: 2.1 time: 0.129032 Jun 17 07:24:57.052525 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 335/682] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:24:56 2022] DELETE /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:24:57.061893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:57.062736 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:57.069308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:57.069895 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:57.070738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:57.071256 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:57.198271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:57.205678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e5374e2d-df7c-4895-9f1c-5dec9e8858af tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1506 microversion: 2.1 time: 0.148561 Jun 17 07:24:57.206865 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 348/683] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:57 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:24:57.739590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:57.740315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:57.746760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:57.747205 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:57.747951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:57.748406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:57.878736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:57.886199 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4ec9b644-7ff5-4cc0-a546-ff189d75091b tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.150802 Jun 17 07:24:57.886766 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 336/684] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:57 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:58.223614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:58.224260 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:58.230784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:58.231235 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:58.231989 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:58.232449 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:58.357016 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:58.364423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fdc53678-be38-4dbd-b83b-49f6e6ec4536 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1506 microversion: 2.1 time: 0.144620 Jun 17 07:24:58.364996 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 349/685] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:58 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:58.902823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:58.903439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:58.909963 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:58.910416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:58.911180 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:58.911622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:59.039698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:59.047936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6bb0174d-087f-4415-ac6d-6b5d009794c2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.149076 Jun 17 07:24:59.048538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 337/686] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:58 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:24:59.381857 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:24:59.382695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:24:59.390066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:59.390588 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:59.391477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:24:59.391976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:24:59.523470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:24:59.531767 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-48f29605-d18a-42da-9d5d-8faac2e4663e tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1506 microversion: 2.1 time: 0.153861 Jun 17 07:24:59.532363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 350/687] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:24:59 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:00.064523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:00.065139 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:00.071604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:00.072056 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:00.072887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:00.073323 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:00.199593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:00.206924 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-eea20da6-f492-4722-ac64-c24bcac25bb4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.146865 Jun 17 07:25:00.207485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 338/688] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:00 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:00.549540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:00.550247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:00.556905 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:00.557347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:00.558106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:00.558717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:00.685284 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:00.692832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-71fb0a7e-99ea-4a0e-b5cb-7a31c7ba02ef tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 200 len: 1506 microversion: 2.1 time: 0.147690 Jun 17 07:25:00.693417 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 351/689] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:00 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:01.130716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-7720b529-fe87-4ac7-8590-4dcc3325965c req-806f94fd-ecf9-4f89-9794-84a64dc2a67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d88b5d-9a22-4092-a847-ca3fdb686228", "name": "network-vif-deleted", "tag": "b91810a2-f141-4e45-96ab-9963b0a82c19"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:01.139448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-7720b529-fe87-4ac7-8590-4dcc3325965c req-806f94fd-ecf9-4f89-9794-84a64dc2a67e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.139890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-7720b529-fe87-4ac7-8590-4dcc3325965c req-806f94fd-ecf9-4f89-9794-84a64dc2a67e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.151110 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-7720b529-fe87-4ac7-8590-4dcc3325965c req-806f94fd-ecf9-4f89-9794-84a64dc2a67e service nova] Creating event network-vif-deleted:b91810a2-f141-4e45-96ab-9963b0a82c19 for instance 12d88b5d-9a22-4092-a847-ca3fdb686228 on hv-cinder-83482 Jun 17 07:25:01.157338 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-7720b529-fe87-4ac7-8590-4dcc3325965c req-806f94fd-ecf9-4f89-9794-84a64dc2a67e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030098 Jun 17 07:25:01.158129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 339/690] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:01.223302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:01.223910 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:01.229849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.230294 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.231054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.231490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.361712 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:01.369065 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2055ec8f-ae1c-4f53-bda8-6fe6215cc8b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.149636 Jun 17 07:25:01.369656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 352/691] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:01 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:01.709520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:01.710227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 12d88b5d-9a22-4092-a847-ca3fdb686228] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:01.716440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.716908 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.717647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.718083 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.731015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] HTTP exception thrown: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Request method failure captured: Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 HTTP/1.1 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCscJCyreH5VH1x6U-gcUfpCNMF94Gukf8B1SqdB3M-TpmI9QAKJpH2k_r2ih9mvGlvgdtXO1R1G4fgffNI4JGTaFv1wfc5jyq8p9i1waO3Q1uXKHqJqqSM0zkbOk0yJxzo3kPqR3mD3MwjdS-G3hZKKiWyI1hoQqcDEisCjZKUWi1E Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:25:01.732682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: c11f44eb67cd4923a840171833bb572a Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. Jun 17 07:25:01.734229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '12d88b5d-9a22-4092-a847-ca3fdb686228'} Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:25:01.735102 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. Jun 17 07:25:01.736644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:01.738021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Returning 404 to user: Instance 12d88b5d-9a22-4092-a847-ca3fdb686228 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:25:01.738021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4ee71d1c-903f-4729-a0fd-417765febab3 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228" status: 404 len: 111 microversion: 2.1 time: 0.028868 Jun 17 07:25:01.738021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 340/692] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:01 2022] GET /compute/v2.1/servers/12d88b5d-9a22-4092-a847-ca3fdb686228 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:25:01.742428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:01.742890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:01.749598 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.750045 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.750797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.751226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.776530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:25:01.802243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:01.854472 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-82175691-e9fb-4f09-98a0-b7cda0315350 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 204 len: 0 microversion: 2.1 time: 0.115518 Jun 17 07:25:01.855765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 353/693] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:25:01 2022] DELETE /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:25:01.864790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:01.865456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:01.872416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.872849 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:01.874134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:01.874624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:02.010367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:02.020042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cc21763e-dcac-4faa-ae90-ce27ec80050b tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.159317 Jun 17 07:25:02.020647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 341/694] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:01 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:02.386388 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:02.387368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:02.394461 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:02.394915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:02.395698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:02.396170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:02.527342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:02.535247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e72f892b-de3c-4f80-80b6-312393794a56 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.153100 Jun 17 07:25:02.535802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 354/695] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:02 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:03.037231 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:03.037839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:03.044842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:03.045306 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:03.046059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:03.046499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:03.064268 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:03.172886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:03.180259 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5187a70b-5153-441a-a14b-f28aec82a7b4 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.146848 Jun 17 07:25:03.180822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 342/696] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:03 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:03.552391 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:03.553011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:03.559498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:03.559950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:03.560745 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:03.561833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:03.685253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:03.693209 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b800bfe1-9654-4eae-93e9-cc229015335d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.144728 Jun 17 07:25:03.693775 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 355/697] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:03 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:03.976193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-fcacb1da-b6eb-447d-bd31-83b57d416600 req-4bcf3d58-a533-40f1-92a2-3664d1526393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09501bed-6039-46fb-8dd3-6a6fba9865ed", "name": "network-vif-plugged", "status": "completed", "tag": "8ad0ac99-8aca-4f10-a23a-7c33706d11e5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:03.985042 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-fcacb1da-b6eb-447d-bd31-83b57d416600 req-4bcf3d58-a533-40f1-92a2-3664d1526393 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:03.985489 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-fcacb1da-b6eb-447d-bd31-83b57d416600 req-4bcf3d58-a533-40f1-92a2-3664d1526393 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:03.998182 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-fcacb1da-b6eb-447d-bd31-83b57d416600 req-4bcf3d58-a533-40f1-92a2-3664d1526393 service nova] Creating event network-vif-plugged:8ad0ac99-8aca-4f10-a23a-7c33706d11e5 for instance 09501bed-6039-46fb-8dd3-6a6fba9865ed on hv-cinder-83482 Jun 17 07:25:04.003445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-fcacb1da-b6eb-447d-bd31-83b57d416600 req-4bcf3d58-a533-40f1-92a2-3664d1526393 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031001 Jun 17 07:25:04.004027 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 343/698] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:04.198718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:04.199330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:04.201293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:04.207735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:04.208198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:04.208971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:04.209438 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:04.223890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:04.337917 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:04.345512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1e106648-0718-44ae-a4d5-fd812904abff tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.150737 Jun 17 07:25:04.346077 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 356/699] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:04 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:04.707635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:04.712708 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:04.713480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:04.720698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:04.721148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:04.721907 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:04.722343 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:05.004797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:05.012247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-81a5ba74-c4e1-48e1-bbbd-921c10242d7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.306002 Jun 17 07:25:05.012807 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 344/700] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:04 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:05.362518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:05.363196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:05.369984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:05.371810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:05.371810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:05.371810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:05.503764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:05.512124 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8d4139dd-2c70-4a05-812a-735f6a42a237 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1521 microversion: 2.1 time: 0.153412 Jun 17 07:25:05.512706 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 357/701] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:05 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:05.855532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-6143c43f-2d29-447e-abc9-1b2b409a0b8e req-2a4664b2-d5d3-4ef7-84a0-8238f8ab9303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5420c538-ebd6-4349-934d-9cd2d5ec2cfc", "name": "network-vif-deleted", "tag": "679e8420-15a8-4888-a16d-37cc6488380e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:05.861271 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:05.865711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6143c43f-2d29-447e-abc9-1b2b409a0b8e req-2a4664b2-d5d3-4ef7-84a0-8238f8ab9303 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:05.866154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6143c43f-2d29-447e-abc9-1b2b409a0b8e req-2a4664b2-d5d3-4ef7-84a0-8238f8ab9303 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:05.879034 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-6143c43f-2d29-447e-abc9-1b2b409a0b8e req-2a4664b2-d5d3-4ef7-84a0-8238f8ab9303 service nova] Creating event network-vif-deleted:679e8420-15a8-4888-a16d-37cc6488380e for instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc on hv-cinder-83482 Jun 17 07:25:05.884142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-6143c43f-2d29-447e-abc9-1b2b409a0b8e req-2a4664b2-d5d3-4ef7-84a0-8238f8ab9303 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032391 Jun 17 07:25:05.884724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 345/702] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:06.029328 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:06.029971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:06.035931 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:06.036411 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:06.037203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:06.037586 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:06.169095 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:06.177262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-46d527fb-fbd5-47f3-a6b7-fa9d6823fc7f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1363 microversion: 2.1 time: 0.151694 Jun 17 07:25:06.178141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 358/703] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:06 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:06.530861 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:06.531548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:06.538814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:06.539254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:06.540004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:06.540464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:06.571050 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:06.571493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:06.571927 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lazy-loading 'fault' on Instance uuid 5420c538-ebd6-4349-934d-9cd2d5ec2cfc {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:25:06.614036 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11f44eb67cd4923a840171833bb572a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b581a57e3e44e3481b1db445961afc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:06.621526 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c2b76136-3b07-4490-8d79-c5e48a94a9fc tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 200 len: 1312 microversion: 2.1 time: 0.095696 Jun 17 07:25:06.622116 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 346/704] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:06 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:07.194738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:07.195353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:07.202605 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.203063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.203827 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.204321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.347605 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:07.354919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4621128b-2429-4305-a52e-b9260565d9b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1547 microversion: 2.1 time: 0.164047 Jun 17 07:25:07.355474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 359/705] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:07 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:07.371000 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:07.371553 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:07.378549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.378987 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.379728 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.380188 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.456374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8821d1fa-c6d3-4776-83b8-ccd8a72b55f4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089146 Jun 17 07:25:07.456990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 347/706] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:25:07 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:07.637599 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:07.638202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] [instance: 5420c538-ebd6-4349-934d-9cd2d5ec2cfc] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:07.640129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:07.645677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.646123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.646888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:07.647316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:07.663692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] HTTP exception thrown: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Request method failure captured: Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc HTTP/1.1 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCscJCyreH5VH1x6U-gcUfpCNMF94Gukf8B1SqdB3M-TpmI9QAKJpH2k_r2ih9mvGlvgdtXO1R1G4fgffNI4JGTaFv1wfc5jyq8p9i1waO3Q1uXKHqJqqSM0zkbOk0yJxzo3kPqR3mD3MwjdS-G3hZKKiWyI1hoQqcDEisCjZKUWi1E Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:25:07.665513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b581a57e3e44e3481b1db445961afc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 2b581a57e3e44e3481b1db445961afc5 Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102785 Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: c11f44eb67cd4923a840171833bb572a Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102785-project Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. Jun 17 07:25:07.666928 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '5420c538-ebd6-4349-934d-9cd2d5ec2cfc'} Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:25:07.667695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. Jun 17 07:25:07.669223 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:07.670852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] Returning 404 to user: Instance 5420c538-ebd6-4349-934d-9cd2d5ec2cfc could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:25:07.670852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-88d860c1-a3f5-4894-a820-1fa5d25aa910 tempest-ServerRescueNegativeTestJSON-2079102785 tempest-ServerRescueNegativeTestJSON-2079102785-project] 10.222.0.33 "GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc" status: 404 len: 111 microversion: 2.1 time: 0.033173 Jun 17 07:25:07.670852 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 360/707] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:07 2022] GET /compute/v2.1/servers/5420c538-ebd6-4349-934d-9cd2d5ec2cfc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:25:08.641880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-23f939f1-0e50-4878-be6d-300d211602c0 req-fc0b5b10-a072-476b-98d1-efc581d20622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09501bed-6039-46fb-8dd3-6a6fba9865ed", "tag": "8ad0ac99-8aca-4f10-a23a-7c33706d11e5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:08.650206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-23f939f1-0e50-4878-be6d-300d211602c0 req-fc0b5b10-a072-476b-98d1-efc581d20622 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:08.650648 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-23f939f1-0e50-4878-be6d-300d211602c0 req-fc0b5b10-a072-476b-98d1-efc581d20622 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:08.662653 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-23f939f1-0e50-4878-be6d-300d211602c0 req-fc0b5b10-a072-476b-98d1-efc581d20622 service nova] Creating event network-changed:8ad0ac99-8aca-4f10-a23a-7c33706d11e5 for instance 09501bed-6039-46fb-8dd3-6a6fba9865ed on hv-cinder-83482 Jun 17 07:25:08.667868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-23f939f1-0e50-4878-be6d-300d211602c0 req-fc0b5b10-a072-476b-98d1-efc581d20622 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030790 Jun 17 07:25:08.668785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 348/708] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:16.283047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-862094961"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:16.283704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:16.290978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:16.292220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:16.305997 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:16.306510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:16.342506 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c056847a-ada7-4393-b349-f51d9b256b29 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: .version_select at 0x7f8b6d42f040>, body: {"keypair": {"name": "tempest-keypair-214491179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVCMD7fRWWVJ2xschUSX6z6tPh/I8gMTmGj1CHvDEym71/RIbyB3sJ3xuraKfVkkeKVIB/ZDwZ8KKnQmmbG5RrkJtIhekp+kJ/j1YajvtVWbV/GE/sSMdAWwLAUwFmILQ=="}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:16.366316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-c056847a-ada7-4393-b349-f51d9b256b29 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:25:16.372529 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-c056847a-ada7-4393-b349-f51d9b256b29 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:25:16.401654 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c056847a-ada7-4393-b349-f51d9b256b29 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218338 Jun 17 07:25:16.402866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 361/709] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:25:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:16.509625 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.network.security_group_api [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Removing security group 6f2a66bd-c7eb-4a8b-bcd4-b1e9641ae4fd from port a235c10b-e0ee-4b4f-9226-71c00b1d7f9e Jun 17 07:25:16.943467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f02e7c35-b10a-442f-ab07-2e4c4fae01b5 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action" status: 202 len: 0 microversion: 2.1 time: 0.668555 Jun 17 07:25:16.944832 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 349/710] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:25:16 2022] POST /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:25:16.963134 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-b85049af-ed07-48a9-a32e-bd608cd0a017 req-29b1070b-c7f4-4aed-9d4f-947c6bdd1c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:16.982332 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-b85049af-ed07-48a9-a32e-bd608cd0a017 req-29b1070b-c7f4-4aed-9d4f-947c6bdd1c85 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:16.985676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-b85049af-ed07-48a9-a32e-bd608cd0a017 req-29b1070b-c7f4-4aed-9d4f-947c6bdd1c85 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:16.999221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-b85049af-ed07-48a9-a32e-bd608cd0a017 req-29b1070b-c7f4-4aed-9d4f-947c6bdd1c85 service nova] Creating event network-changed:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:25:17.009554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-b85049af-ed07-48a9-a32e-bd608cd0a017 req-29b1070b-c7f4-4aed-9d4f-947c6bdd1c85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050516 Jun 17 07:25:17.010861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 362/711] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:18.179573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593758680", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69bdf73b-b655-40e8-99ba-01f63a3ac44d"}], "security_groups": [{"name": "tempest-securitygroup--1642694124"}], "key_name": "tempest-keypair-214491179", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:18.309980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] validate_networks() for [('69bdf73b-b655-40e8-99ba-01f63a3ac44d', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:25:18.795493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:25:18.795990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:25:18.796563 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:25:18.797230 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:25:18.797760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:25:18.808824 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:18.809614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:18.810626 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:18.811615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:18.829339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:25:18.833334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:25:18.844421 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:25:18.846772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:25:18.896135 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c3e5ef0d-4423-49b9-87ae-7ed4bed77b7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721271 Jun 17 07:25:18.896892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 350/712] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:25:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:25:18.907703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a187ae78-631b-43bc-bfe6-b33fc7675944 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:18.908399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a187ae78-631b-43bc-bfe6-b33fc7675944 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:19.000421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a187ae78-631b-43bc-bfe6-b33fc7675944 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:19.008758 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a187ae78-631b-43bc-bfe6-b33fc7675944 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1241 microversion: 2.1 time: 0.105380 Jun 17 07:25:19.010315 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 363/713] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:18 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:25:19.075479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:19.075986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:19.088677 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:19.089357 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:19.090281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:19.090881 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:19.161640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-ae05b8e8-ee82-4ac7-989d-c9faeb6e8d65 req-9d6dfaf4-e852-4382-b1da-87569f574b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:19.176046 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ae05b8e8-ee82-4ac7-989d-c9faeb6e8d65 req-9d6dfaf4-e852-4382-b1da-87569f574b48 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:19.177585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ae05b8e8-ee82-4ac7-989d-c9faeb6e8d65 req-9d6dfaf4-e852-4382-b1da-87569f574b48 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:19.191771 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-ae05b8e8-ee82-4ac7-989d-c9faeb6e8d65 req-9d6dfaf4-e852-4382-b1da-87569f574b48 service nova] Creating event network-changed:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:25:19.204587 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lazy-loading 'services' on Instance uuid 06950fd5-d789-44b6-a03d-b996640e1a71 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:25:19.210563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-ae05b8e8-ee82-4ac7-989d-c9faeb6e8d65 req-9d6dfaf4-e852-4382-b1da-87569f574b48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132996 Jun 17 07:25:19.211160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 364/714] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:19.328395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-38017544-a249-4749-945c-a178691d2b7b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments/aa4fefc1-a9aa-4e89-8105-1f188d0d9530" status: 202 len: 0 microversion: 2.1 time: 0.255677 Jun 17 07:25:19.329651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 351/715] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:25:19 2022] DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments/aa4fefc1-a9aa-4e89-8105-1f188d0d9530 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:25:19.338694 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:19.340108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:19.355339 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:19.356208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:19.359776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:19.361410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:19.443936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-adc18bd5-d909-4ad1-9e2d-e842b85e69a9 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109824 Jun 17 07:25:19.445229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 365/716] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:25:19 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:20.027167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:20.028269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:20.039811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:20.042972 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:20.044241 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:20.044846 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:20.172876 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:20.194862 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-18be0ca0-8c81-4a18-9181-a050f57ac7ae tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1237 microversion: 2.1 time: 0.171823 Jun 17 07:25:20.200313 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 352/717] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:20 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1237 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:20.457261 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:20.458961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:20.465902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:20.466955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:20.468682 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:20.469304 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:20.508825 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e86487a5-36f2-4ca0-9ec7-dcd2bcfdc4a3 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055999 Jun 17 07:25:20.513270 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 366/718] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:25:20 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:21.214361 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:21.214971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:21.221383 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.221825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.222581 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.223010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.311978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:21.319725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-67d7f292-8ea6-4896-8693-1a9287590364 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1299 microversion: 2.1 time: 0.109285 Jun 17 07:25:21.320328 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 353/719] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:21 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:21.520316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:21.521240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:21.528362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.528973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.530585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.531130 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.565261 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-40c76e4f-31f8-40a5-a027-47cd21df1839 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049073 Jun 17 07:25:21.565967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 367/720] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:25:21 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:25:21.575802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:21.576331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:21.583275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.583722 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.584541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:21.584975 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:21.663584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] HTTP exception thrown: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 is not attached to volume aa4fefc1-a9aa-4e89-8105-1f188d0d9530 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Request method failure captured: Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments/aa4fefc1-a9aa-4e89-8105-1f188d0d9530 HTTP/1.1 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCu2dMyQKSLpfIiMHQFDBzHs2cUNQ71ghWlsF96FnVzYc_-VlhV09njhM6QsnrLz-FJyWwcwSGaQhU47qNQcOlyUxzy1_-Byl3JrXMTdhvd-01xlZIMDEHlD96y0dU56Lu--cSkH7EscrIJVVLT_FbOOVWYyp9SvhKbKP4VN90U3zKo Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 52a029f97a9e4142802a9786ae2f6d58 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:25:21.677496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 52a029f97a9e4142802a9786ae2f6d58 Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-TestMinimumBasicScenario-190677757-project Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: a21116ea64234269bba8b0369fb19b59 Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-TestMinimumBasicScenario-190677757-project Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:25:21.679092 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 is not attached to volume aa4fefc1-a9aa-4e89-8105-1f188d0d9530 Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'server_id': '06950fd5-d789-44b6-a03d-b996640e1a71', 'id': 'aa4fefc1-a9aa-4e89-8105-1f188d0d9530'} Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aa4fefc1-a9aa-4e89-8105-1f188d0d9530. Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:25:21.679880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 is not attached to volume aa4fefc1-a9aa-4e89-8105-1f188d0d9530 Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 is not attached to volume aa4fefc1-a9aa-4e89-8105-1f188d0d9530 Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:25:21.681367 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Returning 404 to user: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 is not attached to volume aa4fefc1-a9aa-4e89-8105-1f188d0d9530 {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:25:21.682636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-77f2cb23-3e54-4760-9c89-398fe55866d4 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments/aa4fefc1-a9aa-4e89-8105-1f188d0d9530" status: 404 len: 154 microversion: 2.1 time: 0.107277 Jun 17 07:25:21.682636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 354/721] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:25:21 2022] DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71/os-volume_attachments/aa4fefc1-a9aa-4e89-8105-1f188d0d9530 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:25:22.219341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-2e8bf8af-e4fe-422f-94d2-6a0f0cdcce99 req-afe0ef93-80c4-4acc-8815-cab137dcd88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfd3a40-1403-42b7-a67e-0c3ba06d253f", "tag": "d2ebaf58-5cce-403d-9c3e-f3aa34003d90"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:22.227660 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2e8bf8af-e4fe-422f-94d2-6a0f0cdcce99 req-afe0ef93-80c4-4acc-8815-cab137dcd88a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.228117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-2e8bf8af-e4fe-422f-94d2-6a0f0cdcce99 req-afe0ef93-80c4-4acc-8815-cab137dcd88a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.241776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-2e8bf8af-e4fe-422f-94d2-6a0f0cdcce99 req-afe0ef93-80c4-4acc-8815-cab137dcd88a service nova] Creating event network-changed:d2ebaf58-5cce-403d-9c3e-f3aa34003d90 for instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f on hv-cinder-83482 Jun 17 07:25:22.247595 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-2e8bf8af-e4fe-422f-94d2-6a0f0cdcce99 req-afe0ef93-80c4-4acc-8815-cab137dcd88a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105344 Jun 17 07:25:22.248226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 368/722] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:25:22.340163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:22.341575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:22.349493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.350021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.351145 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.351901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.554668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:22.562673 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cc1ce96c-ccce-44bd-b2e3-22f5a1ef7a1f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.228844 Jun 17 07:25:22.563245 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 355/723] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:22 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:22.828950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:22.829532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:22.836349 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.836790 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.837543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.837973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.862562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:25:22.934866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3a60c485-cb2b-47e3-a68e-f031c3f809e2 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 204 len: 0 microversion: 2.1 time: 0.110346 Jun 17 07:25:22.935443 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 369/724] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:25:22 2022] DELETE /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:25:22.946972 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:22.946972 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:22.950970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.951429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:22.952211 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:22.952774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:23.081015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:23.088410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7ecf62d0-1b25-4185-8179-375d04c900f8 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1554 microversion: 2.1 time: 0.148096 Jun 17 07:25:23.088964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 356/725] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:22 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:25:23.580500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:23.581206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:23.587293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:23.587744 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:23.588542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:23.588981 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:23.718710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:23.726466 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a4454829-4e79-4c40-8089-def40662ee51 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.150716 Jun 17 07:25:23.727017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 370/726] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:23 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:24.106711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:24.107323 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:24.114235 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:24.114680 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:24.115425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:24.115859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:24.242667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:24.250664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7fac63e5-9c72-4c99-b797-cbb59b1cbf57 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1554 microversion: 2.1 time: 0.147833 Jun 17 07:25:24.251217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 357/727] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:24 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:24.742627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:24.743236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:24.749976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:24.750429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:24.751205 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:24.751635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:24.879892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:24.887235 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f8e5f909-a635-48a7-97f6-6a20441c77d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.148446 Jun 17 07:25:24.887805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 371/728] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:24 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:25.267942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:25.268580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:25.275033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:25.275484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:25.276278 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:25.276719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:25.432316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:25.440186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-808284f3-ba6c-4176-8c19-4313df158143 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1554 microversion: 2.1 time: 0.176648 Jun 17 07:25:25.440750 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 358/729] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:25 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:25.904711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:25.905426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:25.912737 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:25.913276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:25.914122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:25.914781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:25.934926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:26.057264 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:26.065373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-734dcfd1-1f85-457b-9d35-2a994fa67bd4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.164621 Jun 17 07:25:26.065941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 372/730] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:25 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:26.221346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-677349cc-8a41-40ac-a360-f3f9d35773a7 req-109fb68c-83ae-4787-9882-2ddfb150af90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06950fd5-d789-44b6-a03d-b996640e1a71", "name": "network-vif-deleted", "tag": "a235c10b-e0ee-4b4f-9226-71c00b1d7f9e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:26.229585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-677349cc-8a41-40ac-a360-f3f9d35773a7 req-109fb68c-83ae-4787-9882-2ddfb150af90 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:26.230035 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-677349cc-8a41-40ac-a360-f3f9d35773a7 req-109fb68c-83ae-4787-9882-2ddfb150af90 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:26.241717 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-677349cc-8a41-40ac-a360-f3f9d35773a7 req-109fb68c-83ae-4787-9882-2ddfb150af90 service nova] Creating event network-vif-deleted:a235c10b-e0ee-4b4f-9226-71c00b1d7f9e for instance 06950fd5-d789-44b6-a03d-b996640e1a71 on hv-cinder-83482 Jun 17 07:25:26.247142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-677349cc-8a41-40ac-a360-f3f9d35773a7 req-109fb68c-83ae-4787-9882-2ddfb150af90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029999 Jun 17 07:25:26.247808 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 359/731] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:25:26.456799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:26.457576 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:26.463612 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:26.464060 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:26.464846 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:26.465281 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:26.496426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:26.496866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:26.497310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lazy-loading 'fault' on Instance uuid 06950fd5-d789-44b6-a03d-b996640e1a71 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:25:26.538961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21116ea64234269bba8b0369fb19b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52a029f97a9e4142802a9786ae2f6d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:26.547325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ffa9a792-7a80-46f5-9ba1-91e06c091359 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 200 len: 1349 microversion: 2.1 time: 0.094311 Jun 17 07:25:26.547910 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 373/732] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:26 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:27.083193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:27.083890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:27.090069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:27.090513 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:27.091260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:27.091690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:27.218176 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:27.225606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-93b6f96e-a878-41c4-8973-ec8a31e3c79e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.147119 Jun 17 07:25:27.226165 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 360/733] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:27 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:27.564248 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:27.564855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] [instance: 06950fd5-d789-44b6-a03d-b996640e1a71] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:27.571340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:27.571783 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:27.572553 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:27.572984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:27.586128 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] HTTP exception thrown: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Request method failure captured: Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 HTTP/1.1 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCu2dMyQKSLpfIiMHQFDBzHs2cUNQ71ghWlsF96FnVzYc_-VlhV09njhM6QsnrLz-FJyWwcwSGaQhU47qNQcOlyUxzy1_-Byl3JrXMTdhvd-01xlZIMDEHlD96y0dU56Lu--cSkH7EscrIJVVLT_FbOOVWYyp9SvhKbKP4VN90U3zKo Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 52a029f97a9e4142802a9786ae2f6d58 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:25:27.587710 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/52a029f97a9e4142802a9786ae2f6d58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 52a029f97a9e4142802a9786ae2f6d58 Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-TestMinimumBasicScenario-190677757 Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-TestMinimumBasicScenario-190677757-project Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: a21116ea64234269bba8b0369fb19b59 Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-TestMinimumBasicScenario-190677757-project Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. Jun 17 07:25:27.589255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '06950fd5-d789-44b6-a03d-b996640e1a71'} Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:25:27.590088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. Jun 17 07:25:27.591333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:25:27.592531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Returning 404 to user: Instance 06950fd5-d789-44b6-a03d-b996640e1a71 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:25:27.592531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0a0418d3-89cf-4786-9924-bca4ede688e0 tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71" status: 404 len: 111 microversion: 2.1 time: 0.029344 Jun 17 07:25:27.592531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 374/734] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:27 2022] GET /compute/v2.1/servers/06950fd5-d789-44b6-a03d-b996640e1a71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:25:27.597809 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-58a07b2f-fad9-489a-87d8-46b788ec704b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] Calling method '.version_select at 0x7f8b6d2f5310>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:27.615136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-58a07b2f-fad9-489a-87d8-46b788ec704b tempest-TestMinimumBasicScenario-190677757 tempest-TestMinimumBasicScenario-190677757-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1140170078" status: 202 len: 0 microversion: 2.1 time: 0.021177 Jun 17 07:25:27.615674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 361/735] 10.222.0.33 () {58 vars in 1271 bytes} [Fri Jun 17 07:25:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1140170078 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:25:28.051672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-168ea3ac-c88f-416f-ae90-52d24f85cd0c req-2316e39e-a5e5-41a5-a094-7fac1fd250b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfd3a40-1403-42b7-a67e-0c3ba06d253f", "name": "network-vif-plugged", "status": "completed", "tag": "d2ebaf58-5cce-403d-9c3e-f3aa34003d90"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:28.062089 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-168ea3ac-c88f-416f-ae90-52d24f85cd0c req-2316e39e-a5e5-41a5-a094-7fac1fd250b8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:28.062785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-168ea3ac-c88f-416f-ae90-52d24f85cd0c req-2316e39e-a5e5-41a5-a094-7fac1fd250b8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:28.074578 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-168ea3ac-c88f-416f-ae90-52d24f85cd0c req-2316e39e-a5e5-41a5-a094-7fac1fd250b8 service nova] Creating event network-vif-plugged:d2ebaf58-5cce-403d-9c3e-f3aa34003d90 for instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f on hv-cinder-83482 Jun 17 07:25:28.080047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-168ea3ac-c88f-416f-ae90-52d24f85cd0c req-2316e39e-a5e5-41a5-a094-7fac1fd250b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Jun 17 07:25:28.081207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 375/736] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:25:28.243787 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:28.244597 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:28.251527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:28.251977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:28.252794 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:28.253374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:28.637368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:28.645475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-eabe7f05-ae66-42bd-b2e3-1a1337735df1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.406555 Jun 17 07:25:28.646037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 362/737] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:28 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:29.271791 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:29.396014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:29.396576 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:29.406217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:29.406974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:29.408342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:29.409104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:29.435747 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0dff5729-5d86-4aea-9332-dca64e5b9c36 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/ips" status: 200 len: 152 microversion: 2.20 time: 0.165385 Jun 17 07:25:29.436786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 376/738] 10.222.0.33 () {60 vars in 1288 bytes} [Fri Jun 17 07:25:29 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/ips => generated 152 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:25:29.663612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:29.664749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:29.668590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:29.672094 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:29.681428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:29.682441 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:29.683609 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:29.684147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:29.713269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:29.871411 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:29.883780 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bbcd9756-f39b-44bd-93b9-dbeb8baff498 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1367 microversion: 2.1 time: 0.224280 Jun 17 07:25:29.885697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 363/739] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:29 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:30.902425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:30.903054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:30.909939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:30.910486 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:30.911325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:30.911835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.078241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:31.085970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-75782137-76c3-4cd6-bb7f-ab0a8f39a912 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1558 microversion: 2.1 time: 0.187441 Jun 17 07:25:31.086548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 377/740] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:30 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:25:31.102931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:31.103373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:31.110647 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.111094 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.111861 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.112326 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.211755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6c73a81e-82aa-41a7-8bdf-e90b68f65a57 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112714 Jun 17 07:25:31.212463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 364/741] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:25:31 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:31.402361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:31.402893 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:31.409904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.410353 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.411118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.411753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.443221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lazy-loading 'flavor' on Instance uuid 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:25:31.724498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-00cd6d43-8998-4234-9d17-d4765d21c12e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/action" status: 202 len: 0 microversion: 2.20 time: 0.325812 Jun 17 07:25:31.725293 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 378/742] 10.222.0.33 () {62 vars in 1318 bytes} [Fri Jun 17 07:25:31 2022] POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:25:31.733389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:31.734362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:31.750856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.751589 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.752431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:31.752875 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:31.976826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:31.984912 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:31.987089 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:31.988937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-464ab3e9-5718-4526-94c4-f3dd8ed61776 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.259500 Jun 17 07:25:31.989604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 365/743] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:31 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:32.545208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-4252cd05-35e8-4742-b1ea-d9eb79785e1b req-949c6fc7-e7a6-4402-9bab-69e609d77121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfd3a40-1403-42b7-a67e-0c3ba06d253f", "tag": "d2ebaf58-5cce-403d-9c3e-f3aa34003d90"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:32.571926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4252cd05-35e8-4742-b1ea-d9eb79785e1b req-949c6fc7-e7a6-4402-9bab-69e609d77121 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:32.572326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-4252cd05-35e8-4742-b1ea-d9eb79785e1b req-949c6fc7-e7a6-4402-9bab-69e609d77121 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:32.592587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-4252cd05-35e8-4742-b1ea-d9eb79785e1b req-949c6fc7-e7a6-4402-9bab-69e609d77121 service nova] Creating event network-changed:d2ebaf58-5cce-403d-9c3e-f3aa34003d90 for instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f on hv-cinder-83482 Jun 17 07:25:32.598945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-4252cd05-35e8-4742-b1ea-d9eb79785e1b req-949c6fc7-e7a6-4402-9bab-69e609d77121 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058653 Jun 17 07:25:32.599965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 379/744] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:33.008184 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:33.008802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:33.016374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:33.016834 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:33.017619 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:33.018062 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:33.275368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:33.289541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:33.292772 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:33.297377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fe680725-3611-4d4e-a003-7e86ba2a07b9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.292356 Jun 17 07:25:33.299277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 366/745] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:33 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:34.319219 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:34.320299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:34.326890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:34.327535 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:34.329186 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:34.330108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:34.560292 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:34.571093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:34.572636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:34.574091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-25886b03-146d-48d5-bdfd-48aa0d0466fd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.260499 Jun 17 07:25:34.574642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 380/746] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:34 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:35.592734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:35.593457 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:35.600060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.600538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.601297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:35.601734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:35.997208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:36.006426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:36.008379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:36.010691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-dcd53ea4-9bdc-43eb-8910-1741afa93d49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.421622 Jun 17 07:25:36.012154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 367/747] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:35 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:37.029243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:37.030104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:37.039392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:37.040094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:37.040890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:37.041330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:37.184261 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:37.193113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:37.194902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:37.196108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-59f1548f-f885-4e84-8ef8-6980320525b5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.170972 Jun 17 07:25:37.196832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 381/748] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:37 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:38.215474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:38.216704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:38.223501 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:38.225821 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:38.226430 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:38.227906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:38.228560 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:38.517705 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:38.526617 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:38.528191 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:38.529369 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5f1f0c37-edd6-4d6c-bcbb-f5829bd61c6c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.318382 Jun 17 07:25:38.530456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 368/749] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:38 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:39.550835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:39.552291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:39.564864 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:39.565984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:39.569222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:39.570141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:39.794855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:39.806372 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:39.808534 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:39.809815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0118919e-e69d-485a-b9ef-421939f81b78 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.265459 Jun 17 07:25:39.810627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 382/750] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:39 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:40.832286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:40.832932 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:40.839532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:40.839996 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:40.840806 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:40.841253 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:41.008200 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:41.020091 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:41.021841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:41.023305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a1829c23-7b56-4431-9efb-8beee0b49362 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.197986 Jun 17 07:25:41.023999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 369/751] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:40 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:42.042081 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:42.042693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:42.050069 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:42.050516 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:42.051511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:42.052150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:42.205042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:42.217906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:42.219518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:42.220759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cc47df96-ac7e-4c09-9c78-fc6660f974ac tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.182990 Jun 17 07:25:42.221276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 383/752] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:42 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:43.239787 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:43.241043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:43.252698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:43.261198 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:43.262700 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:43.263747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:43.557979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:43.568274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:43.570462 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:43.572269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3719d62c-ba7e-40a2-9085-8c2cd3c4fa49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.337474 Jun 17 07:25:43.573585 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 370/753] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:43 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:44.591822 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:44.593459 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:44.605341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:44.606181 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:44.608113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:44.617311 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:44.887561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:44.926781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:44.929708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:44.933205 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-be7e240a-4e72-4f9b-b0ed-e07934bd4f72 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.344130 Jun 17 07:25:44.941134 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 384/754] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:44 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:45.965985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:45.967067 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:46.001745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:46.002494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:46.008353 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:46.009117 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:46.280928 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:46.304523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:46.307222 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:46.308997 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c8436df7-2bcb-4d09-adfb-cf74392730dd tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.349919 Jun 17 07:25:46.309565 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 371/755] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:45 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:46.716726 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:46.718378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:46.734388 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:46.736912 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:46.737729 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:46.738781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:46.739421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:46.767157 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-07b5670f-f691-4e47-8931-e7027982b368 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/ips" status: 200 len: 144 microversion: 2.1 time: 0.054242 Jun 17 07:25:46.786685 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 385/756] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:25:46 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/ips => generated 144 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:47.021594 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-153e72d8-2bbc-4a7a-8a43-74b2a578f677 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Action: 'create', calling method: .version_select at 0x7f8b6d2ee8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1704693656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlYFYEUkXbHzHmDPO95sEDIu+aZk3ATpx03kBUDH8DW62tMya+CqJ14gPoOOB/5wrZivpbCkR6rt162kgv/A6zejV/OBpaL5ilkOfkm9i0P1ASkcTt7JI5EjRDWCQMQQw=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:47.049553 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-153e72d8-2bbc-4a7a-8a43-74b2a578f677 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for project d2b7ae6a418640629020f39ac455d075. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:25:47.057554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-153e72d8-2bbc-4a7a-8a43-74b2a578f677 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for user 6a113fe9b988458d8e8898c5c9a8d02d and project d2b7ae6a418640629020f39ac455d075. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:25:47.091379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-153e72d8-2bbc-4a7a-8a43-74b2a578f677 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.271612 Jun 17 07:25:47.092959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 372/757] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:25:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:47.333132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:47.335242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:47.358340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:47.359391 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:47.361000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:47.361564 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:47.874255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:47.884543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:47.886197 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:47.887536 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d03ab7b8-e71f-4674-a442-5d418e52023d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1744 microversion: 2.20 time: 0.561303 Jun 17 07:25:47.888285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 386/758] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:47 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1744 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:48.209562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05a7e58d-0b5e-4975-84d9-065fa9300ce1"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:48.211426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:48.220004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:48.221605 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:48.223274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:48.223942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:48.576966 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-318a656d-7933-4d68-82f6-c647da84bcb8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371660 Jun 17 07:25:48.578896 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 373/759] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:25:48 2022] POST /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:48.907360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:48.908052 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:48.914518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:48.915066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:48.915803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:48.916280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:49.067113 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:49.075360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:49.077541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:49.078780 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-823d8d7e-13db-404d-ac21-ccb1af72e456 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1744 microversion: 2.20 time: 0.175713 Jun 17 07:25:49.079407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 387/760] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:48 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:50.096962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:50.097853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:50.105453 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:50.105898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:50.106678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:50.107316 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:50.212378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-68c39b10-1c85-47de-ba05-26285bc5875b req-d9fedcea-3b82-4d7b-9643-a927fc725ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "name": "network-vif-plugged", "status": "completed", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:50.223250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-68c39b10-1c85-47de-ba05-26285bc5875b req-d9fedcea-3b82-4d7b-9643-a927fc725ad6 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:50.223915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-68c39b10-1c85-47de-ba05-26285bc5875b req-d9fedcea-3b82-4d7b-9643-a927fc725ad6 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:50.237803 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-68c39b10-1c85-47de-ba05-26285bc5875b req-d9fedcea-3b82-4d7b-9643-a927fc725ad6 service nova] Creating event network-vif-plugged:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:25:50.243476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-68c39b10-1c85-47de-ba05-26285bc5875b req-d9fedcea-3b82-4d7b-9643-a927fc725ad6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131210 Jun 17 07:25:50.244922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 388/761] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:25:50.309066 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:50.318732 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:50.320432 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:50.321781 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b4628dfc-3536-44e5-abe6-8218741b0851 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1744 microversion: 2.20 time: 0.229393 Jun 17 07:25:50.322355 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 374/762] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:50 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:51.343577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:51.344301 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:51.351191 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:51.352787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:51.354079 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:51.354897 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:51.543091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:51.552642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:51.554221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:51.555890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6beeea01-1d1b-4c5a-befc-4ed5e0f6fb49 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.217859 Jun 17 07:25:51.557028 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 389/763] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:51 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:52.578280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:52.579018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:52.594291 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:52.594873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:52.595764 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:52.596320 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:52.762708 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:52.772377 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:52.778448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:52.780010 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5d88fddc-287f-4edd-8050-c2d431a19289 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.206800 Jun 17 07:25:52.780790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 375/764] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:52 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:53.798966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:53.799571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:53.812636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:53.813627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:53.814757 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:53.815541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:53.821785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:54.010247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:54.020205 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:54.023247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:54.025508 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-4a4e5315-b11e-4ceb-8606-1f9e518c6ff9 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.230845 Jun 17 07:25:54.037715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 390/765] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:53 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:55.054105 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:55.055350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:55.073203 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:55.074055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:55.075901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:55.078138 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:55.297447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:55.311843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:55.315409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:55.316843 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ee9de10c-544c-47eb-b398-e80ab97569c3 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.275017 Jun 17 07:25:55.317935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 376/766] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:55 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:56.319017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:56.320389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:56.327482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.328053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.329096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.330114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.335737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:56.336577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:56.345950 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.346404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.347196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.347744 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.368773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-feece29e-bf7c-4eef-b0e8-a37e5f53d88f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054080 Jun 17 07:25:56.370187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 391/767] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:25:56 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:56.386002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:56.386753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:56.402206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.402922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.403905 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:56.404381 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:56.445593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c9a4b856-d8c2-4e52-b381-73ff7a2fac4f tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1" status: 200 len: 194 microversion: 2.1 time: 0.069407 Jun 17 07:25:56.452820 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 392/768] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Jun 17 07:25:56 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:25:56.544291 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:56.559040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:56.561073 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:56.562988 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4979f365-bbea-4f2c-a7bf-355e8cee7e68 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.232170 Jun 17 07:25:56.564234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 377/769] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:56 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:25:57.582917 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:57.584355 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:57.597317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:57.598276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:57.599813 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:57.600792 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:57.779058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:57.788945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:57.790609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:57.791810 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a9fa225c-bd67-49e9-b266-21b5864c1058 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.212933 Jun 17 07:25:57.792404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 393/770] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:57 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:57.936431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2215c2b9-7b80-4dfc-a011-936fe433f5a7"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:57.938715 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:57.940970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:57.947802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:57.948535 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:57.949663 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:57.950379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.275413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:25:58.310019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bac7b268-5ae5-4ace-a9c9-c49e59a75d3d tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "POST /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381158 Jun 17 07:25:58.316723 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 378/771] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:25:57 2022] POST /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:25:58.603428 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:25:58.604236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:58.610663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.611106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.612898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.613629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.640934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lazy-loading 'flavor' on Instance uuid 6b5c89eb-5da9-4ad8-8576-55a011ab582d {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:25:58.754647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2c457400-6107-4bcb-8b84-86ee62d80a14 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "POST /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d/action" status: 202 len: 0 microversion: 2.1 time: 0.154715 Jun 17 07:25:58.755352 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 394/772] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:25:58 2022] POST /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:25:58.766291 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:58.767655 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:58.781649 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.782733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.783826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.784590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.813198 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:25:58.817533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:25:58.832027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.832646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:58.835142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:25:58.835787 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:25:59.000138 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:59.009377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:59.012773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:59.014533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5182f1c3-c315-4b65-b15e-cdd689a2d0a6 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.205894 Jun 17 07:25:59.025234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 395/773] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:25:58 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:25:59.042552 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:25:59.052088 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aef3b16e-b027-4485-befe-c0198566ac4d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.291797 Jun 17 07:25:59.065414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 379/774] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:25:58 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:00.033587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:00.034474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:00.042120 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:00.042721 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:00.043707 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:00.044179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:00.074142 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:00.074842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:00.087151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:00.087923 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:00.088777 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:00.089324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:00.250523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:00.251950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:00.260689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f0bcc3b1-5486-408a-8ec2-41a4ed8dc00c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.191360 Jun 17 07:26:00.268681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 380/775] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:00 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:00.272342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:00.273856 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:00.275033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-73bfa345-856f-45f0-aeb1-693589644b5d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1739 microversion: 2.20 time: 0.246184 Jun 17 07:26:00.276058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 396/776] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:00 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:01.280168 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:01.280788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:01.289522 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:01.290111 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:01.291105 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:01.291688 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:01.294308 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:01.295566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:01.302122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:01.302569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:01.303341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:01.304194 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:01.438656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:01.446914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:01.448453 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:01.449621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-51b7de8f-b094-43f5-a1fc-70192c7de26b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1721 microversion: 2.20 time: 0.160190 Jun 17 07:26:01.450186 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 397/777] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:01 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:01.494280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:01.502819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-be114bb5-2b8a-449e-8c03-e81e2470e76d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.226964 Jun 17 07:26:01.503399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 381/778] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:01 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:02.470151 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:02.470790 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:02.478135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:02.478663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:02.479500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:02.480001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:02.520328 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:02.520942 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:02.527620 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:02.528083 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:02.528868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:02.529328 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:02.615187 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:02.624518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:02.626314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:02.627695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2f351cbc-d403-4e4f-b489-8f036f0e8d2f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1721 microversion: 2.20 time: 0.163090 Jun 17 07:26:02.628696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 398/779] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:02 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:26:02.918849 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:02.927187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7544a1c4-abdd-4a75-a5e2-c8e8b6e3e2d5 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.410745 Jun 17 07:26:02.927755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 382/780] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:02 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:03.646246 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:03.646794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:03.653452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.653924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:03.655227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.655743 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:03.793146 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:03.802480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:03.803971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:03.805156 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-236dfdd2-7e4d-4a20-8e03-03a876c6306d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1724 microversion: 2.20 time: 0.162918 Jun 17 07:26:03.805718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 399/781] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:03 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:03.822645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cecc84d2-7c62-468c-b65e-dd9a7601e7cb"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:03.823771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:03.830324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.830781 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:03.831545 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.831985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:03.944325 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:03.945020 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:03.952215 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.952833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:03.953647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:03.954160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.126432 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:04.135475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a5d05391-bac7-4d58-a8f3-0813700fa701 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.195510 Jun 17 07:26:04.140141 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 400/782] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:03 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:04.148962 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-d091988f-517b-49d9-a4c5-53770124ae2c req-ac2b8551-6ef2-4410-ae61-976a1c994492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "name": "network-vif-unplugged", "status": "completed", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:04.149747 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ab0d0db7-73a3-49fa-9708-980f63b9bfda tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330798 Jun 17 07:26:04.150440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 383/783] 10.222.0.33 () {62 vars in 1363 bytes} [Fri Jun 17 07:26:03 2022] POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 07:26:04.159983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-d091988f-517b-49d9-a4c5-53770124ae2c req-ac2b8551-6ef2-4410-ae61-976a1c994492 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.160651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-d091988f-517b-49d9-a4c5-53770124ae2c req-ac2b8551-6ef2-4410-ae61-976a1c994492 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.178129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-d091988f-517b-49d9-a4c5-53770124ae2c req-ac2b8551-6ef2-4410-ae61-976a1c994492 service nova] Creating event network-vif-unplugged:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:26:04.188158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-d091988f-517b-49d9-a4c5-53770124ae2c req-ac2b8551-6ef2-4410-ae61-976a1c994492 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044162 Jun 17 07:26:04.188907 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 401/784] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:04.284021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:04.284539 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:04.291932 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.292688 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.293452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.293893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.532680 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-16173a3d-a953-4322-a80e-37bcb9864d7d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments/cecc84d2-7c62-468c-b65e-dd9a7601e7cb" status: 202 len: 0 microversion: 2.20 time: 0.253175 Jun 17 07:26:04.533280 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 384/785] 10.222.0.33 () {60 vars in 1456 bytes} [Fri Jun 17 07:26:04 2022] DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments/cecc84d2-7c62-468c-b65e-dd9a7601e7cb => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:26:04.589883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:04.590531 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:04.597327 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.597766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.598511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.598937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.674974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ca97863c-c53f-43fe-ac3d-6d9ae12d501e tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/action" status: 202 len: 0 microversion: 2.20 time: 0.089122 Jun 17 07:26:04.676115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 402/786] 10.222.0.33 () {62 vars in 1318 bytes} [Fri Jun 17 07:26:04 2022] POST /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:26:04.684196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:04.684807 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:04.690805 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.691257 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.692018 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:04.692480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:04.837668 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:04.846438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:04.847936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:04.849206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-20ab8589-9203-44e0-9140-109d7da53a5c tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1672 microversion: 2.20 time: 0.168880 Jun 17 07:26:04.849790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 385/787] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:04 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:05.154587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:05.155571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:05.162864 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.163412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.164424 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.165074 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.250870 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1768121130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1704693656", "security_groups": [{"name": "tempest-secgroup-smoke-1395766797"}], "block_device_mapping_v2": [{"uuid": "8d26c78d-eaba-4e7b-a776-03068ad47f6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "270f7e8d-fe10-476d-b957-559a5be577a9"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:05.328894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:05.337109 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-12e26750-ded2-4d06-a5eb-4e4e2b968cfe tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.186426 Jun 17 07:26:05.337677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 403/788] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:05 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:05.402480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] validate_networks() for [('270f7e8d-fe10-476d-b957-559a5be577a9', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:26:05.781765 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:26:05.782197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:26:05.782678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:26:05.783089 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:26:05.783503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:26:05.796466 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.796921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.797728 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.798171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.818139 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:26:05.822662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for user 6a113fe9b988458d8e8898c5c9a8d02d and project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:26:05.867938 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:05.868842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:05.876023 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.878489 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.879840 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:05.880316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:05.913722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:05.928937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:26:05.931479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d26c78d-eaba-4e7b-a776-03068ad47f6a',volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:26:06.031383 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:06.039662 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:06.041379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:06.042511 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d995c2d6-65c0-42cd-b4b3-00de7268a625 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.179729 Jun 17 07:26:06.043070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 404/789] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:05 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:26:06.047784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:06.048725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:06.054926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.055408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.056200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.056794 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.070208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1ba3231b-51c6-4824-a728-9f66d7ce6d2d tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823894 Jun 17 07:26:06.070880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 386/790] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:26:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:26:06.081227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c574528a-3948-4e53-993c-a9f1a76648ef tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:06.081849 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c574528a-3948-4e53-993c-a9f1a76648ef tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:06.092669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f6eb0f36-4daa-47dc-87fe-44207733ad7a tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048554 Jun 17 07:26:06.093326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 405/791] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:26:06 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:06.135174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c574528a-3948-4e53-993c-a9f1a76648ef tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:06.143552 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c574528a-3948-4e53-993c-a9f1a76648ef tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1095 microversion: 2.1 time: 0.066014 Jun 17 07:26:06.144339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 387/792] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:06 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:06.237180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:06.237672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:06.244000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.244490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.245268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.245699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.277863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ecb055dd-780e-4a6e-8d41-ec353a1c7d7e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1" status: 200 len: 194 microversion: 2.1 time: 0.044415 Jun 17 07:26:06.278357 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 406/793] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Jun 17 07:26:06 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:06.288744 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:06.289382 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:06.296826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.297490 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.298449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.299067 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.354587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:06.355213 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:06.362150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.362606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.363375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:06.363809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:06.403172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lazy-loading 'services' on Instance uuid 09501bed-6039-46fb-8dd3-6a6fba9865ed {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:26:06.489638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e901009f-4b4e-40d4-93ce-267a09346767 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1" status: 202 len: 0 microversion: 2.1 time: 0.203932 Jun 17 07:26:06.490425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 388/794] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:26:06 2022] DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/05a7e58d-0b5e-4975-84d9-065fa9300ce1 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:26:06.539505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:06.553636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-545f8f12-ca60-4a04-9f09-a7a8722134e1 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.203014 Jun 17 07:26:06.554593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 407/795] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:06 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:07.062553 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:07.063247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:07.069798 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.070252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.071019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.071463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.160955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:07.161574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:07.168370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.168828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.169603 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.170054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.201960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:07.210238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:07.212043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:07.213238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f0bbe3e7-d88f-45ee-9a56-46ff94c18cdf tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.155442 Jun 17 07:26:07.213796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 389/796] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:07 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:07.232346 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:07.239739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b535d202-c1b2-4fa2-a5f2-fca52dc99bf2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1193 microversion: 2.1 time: 0.082574 Jun 17 07:26:07.240330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 408/797] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:07 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:07.570696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:07.571325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:07.577994 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.578466 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.579243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.579681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.671423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:07.672593 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:07.679907 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.680314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.681097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.681801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.743950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2d1a4386-50c9-4664-ac2d-6045b2aa1838 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/2215c2b9-7b80-4dfc-a011-936fe433f5a7" status: 200 len: 194 microversion: 2.1 time: 0.077642 Jun 17 07:26:07.744591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 409/798] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Jun 17 07:26:07 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/2215c2b9-7b80-4dfc-a011-936fe433f5a7 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:07.755835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:07.756639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:07.765028 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.765713 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.766847 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:07.767497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:07.839748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:07.849885 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0eb6e677-91f3-44a2-b03f-cafd0af9f093 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.282986 Jun 17 07:26:07.853651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 390/799] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:07 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:07.905876 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lazy-loading 'services' on Instance uuid 09501bed-6039-46fb-8dd3-6a6fba9865ed {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:26:08.021945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-850be240-d889-49d9-9f83-71d5c834bebe tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/2215c2b9-7b80-4dfc-a011-936fe433f5a7" status: 202 len: 0 microversion: 2.1 time: 0.268112 Jun 17 07:26:08.023657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 410/800] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:26:07 2022] DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments/2215c2b9-7b80-4dfc-a011-936fe433f5a7 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:26:08.232407 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:08.233725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:08.243627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.244366 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:08.245419 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.246643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:08.252167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=7,nova_cell1:UPDATE=8 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:08.258009 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:08.259592 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:08.272295 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.275358 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:08.276310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.277748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:08.413719 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:08.424319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2159c467-d869-42f3-a045-6f3ffa7daa4b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1211 microversion: 2.1 time: 0.170787 Jun 17 07:26:08.435500 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 411/801] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:08 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1211 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:08.584374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:08.593499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:08.594980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:08.596167 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e8daaa2f-83a0-432c-8918-8774cf3c6b4a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.368745 Jun 17 07:26:08.596723 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 391/802] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:08 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:08.872468 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:08.873725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:08.882834 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.884213 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:08.885331 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:08.886429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:09.055949 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:09.064126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6d1cc6ff-51bb-4dad-b88c-dd424917e462 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.196954 Jun 17 07:26:09.069578 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 412/803] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:08 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:09.442181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:09.442831 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:09.445148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:09.453054 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:09.453506 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:09.454279 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:09.454709 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:09.612699 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:09.617541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:09.618143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:09.623082 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d8f9ee49-5550-45b5-a583-d21e0740f507 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.184685 Jun 17 07:26:09.624493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 392/804] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:09 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:09.634695 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:09.635170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:09.635943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:09.636477 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:09.774497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:09.787910 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:09.789542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:09.790984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-73441968-51f6-4a01-aad4-1db97053815a tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.179324 Jun 17 07:26:09.791546 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 413/805] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:09 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:10.083031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:10.084488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:10.091473 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.092980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.093707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.094289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.240230 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:10.248331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-91c3bba7-01a0-43be-8291-05c3ef418b62 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.170201 Jun 17 07:26:10.249100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 393/806] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:10 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:10.641289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:10.642833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:10.649919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.650286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.651236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.651671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.798514 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:10.807108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f01a3ecd-de4d-424c-aacc-74828b65fa31 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.170136 Jun 17 07:26:10.807693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 414/807] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:10 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:10.810275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:10.811503 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:10.818960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.819420 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.820244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:10.820689 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:10.967204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:10.975716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:10.977279 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:10.978498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0792895c-9b2e-4967-a16e-e562a4f0e880 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.172324 Jun 17 07:26:10.979296 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 394/808] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:10 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:26:11.267834 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:11.268562 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:11.282414 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:11.282869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:11.283659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:11.284121 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:11.441802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:11.450470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-42b50d0d-f95a-43f6-9b0e-bdf7733ad760 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.187903 Jun 17 07:26:11.451265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 415/809] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:11 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:11.824675 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:11.825289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:11.833464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:11.833995 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:11.834802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:11.835249 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:11.980936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:11.991270 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c7e2df74-d272-4ade-9e01-2dc5b97351ee tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.170361 Jun 17 07:26:11.992005 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 395/810] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:11 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:11.996983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:11.997831 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:12.004376 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:12.004819 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:12.005577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:12.006002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:12.153081 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:12.162090 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:12.163596 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:12.164799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f48253da-2307-4d62-a6ed-a9b84ab95c53 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.171680 Jun 17 07:26:12.165363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 416/811] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:11 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:12.468083 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:12.468703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:12.475244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:12.475701 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:12.477187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:12.477187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:12.631138 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:12.639913 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-165d5856-7844-4186-902a-c1e376382570 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.175390 Jun 17 07:26:12.640916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 396/812] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:12 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:13.007545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:13.008201 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:13.014719 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.015161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.015934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.016389 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.159000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:13.167219 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f22f322c-faef-4a52-9c58-7aa2679fc700 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.163410 Jun 17 07:26:13.168080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 417/813] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:13 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:13.185732 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:13.186541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:13.193736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.194277 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.195131 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.195645 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.336838 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:13.345480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:13.346974 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:13.348312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7d4b75e8-cacf-41b5-bb77-d4f3bd236505 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.166441 Jun 17 07:26:13.348745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 397/814] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:13 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:13.658097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:13.658627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:13.664730 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.665181 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.665972 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:13.666405 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:13.806115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:13.814313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5908eaf7-ad38-411f-9b49-0f8f371ab7dc tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.160864 Jun 17 07:26:13.815070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 418/815] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:13 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:14.184790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:14.185417 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:14.192667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.193573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:14.193863 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.194303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:14.332985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:14.340737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2cb2298b-4792-4d50-b061-c9d7cf8139e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.159813 Jun 17 07:26:14.341500 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 398/816] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:14 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:14.367436 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:14.368037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:14.375237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.375688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:14.376634 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.377066 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:14.534815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:14.544892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:14.547738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:14.549149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-31f1735b-9af4-48bc-ae12-f808e7efc3bc tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.186028 Jun 17 07:26:14.549969 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 419/817] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:14 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:14.832137 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:14.832835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:14.839739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.840220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:14.841054 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:14.841475 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:15.052408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:15.060785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7554f2eb-ce5a-41d9-9f09-67553804afed tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.232764 Jun 17 07:26:15.061369 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 399/818] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:14 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:15.357650 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:15.358693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:15.366777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:15.367239 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:15.368023 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:15.368600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:15.389528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:15.517910 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:15.526680 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-77b7ac7b-5652-4f17-a905-33a955412ac2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.172999 Jun 17 07:26:15.527487 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 420/819] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:15 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:15.568336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:15.569571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:15.576150 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:15.577130 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:15.577941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:15.578380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:15.716127 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:15.724634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:15.726140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:15.727303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6598773f-ccb7-4a59-b197-57bf0d89a887 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.164394 Jun 17 07:26:15.727891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 400/820] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:15 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:16.079489 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:16.080106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:16.086352 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.086801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.087548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.087974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.200408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:16.200904 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:16.202837 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:16.203625 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=8 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:16.209731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.216445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.218456 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.219264 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.237652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:16.247234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6935cd26-757f-4c67-a814-c1b4ada3f98a tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.172150 Jun 17 07:26:16.247824 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 421/821] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:16 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:16.261683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4a65a136-f676-47d9-91fe-c23519a92972 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/ips" status: 200 len: 151 microversion: 2.1 time: 0.065236 Jun 17 07:26:16.262189 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 401/822] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:26:16 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:16.544661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:16.545299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:16.554373 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.555262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.556336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.557008 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.761037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:16.762612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:16.770734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.771208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.773676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:16.773676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:16.815809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:16.824390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5379488d-1df0-42fd-be1f-930ac42b684f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.283560 Jun 17 07:26:16.834752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 422/823] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:16 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:16.949693 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:16.958371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:16.959870 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:16.961055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-67bd9c3c-7ccd-4047-a318-41f6ce45d465 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.212991 Jun 17 07:26:16.961621 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 402/824] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:16 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:17.264866 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:17.265644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:17.272360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.273038 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:17.273818 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.274657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:17.424971 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:17.443143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-74b2de34-cc01-4690-a24a-2d634e5be6b8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.181957 Jun 17 07:26:17.448453 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 423/825] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:17 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:17.731400 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b55e59f-23b2-446c-aa93-0eac359657a8"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:17.732833 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:17.740206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.740660 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:17.741424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.742036 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:17.847073 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:17.848202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:17.854854 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=80 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:17.857029 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.858176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:17.859038 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:17.859484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.008458 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:18.016303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6157cda8-ad7b-4625-aea1-211eca5fd3c8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1279 microversion: 2.1 time: 0.177822 Jun 17 07:26:18.017583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 424/826] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:17 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:18.022679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:18.023259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:18.029671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:18.030063 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.030813 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:18.031412 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.173580 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:18.182548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:18.184037 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:18.185243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8f57fe4b-025c-47af-a865-a470905628f5 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.166555 Jun 17 07:26:18.186359 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 425/827] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:18 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:18.190984 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-aebf8414-813d-490b-9df8-927ef50b24a8 req-9bf2fd55-430f-4daa-a881-7eb1b7bd98a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47fec78-0275-4db6-a345-a4999f2863b4", "tag": "f987d351-5531-4e29-9020-013999acc4e6"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:18.199622 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-aebf8414-813d-490b-9df8-927ef50b24a8 req-9bf2fd55-430f-4daa-a881-7eb1b7bd98a8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:18.200059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-aebf8414-813d-490b-9df8-927ef50b24a8 req-9bf2fd55-430f-4daa-a881-7eb1b7bd98a8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.213340 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-aebf8414-813d-490b-9df8-927ef50b24a8 req-9bf2fd55-430f-4daa-a881-7eb1b7bd98a8 service nova] Creating event network-changed:f987d351-5531-4e29-9020-013999acc4e6 for instance d47fec78-0275-4db6-a345-a4999f2863b4 on hv-cinder-83482 Jun 17 07:26:18.219440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-aebf8414-813d-490b-9df8-927ef50b24a8 req-9bf2fd55-430f-4daa-a881-7eb1b7bd98a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031733 Jun 17 07:26:18.220314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 426/828] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:18.462658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:18.463351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:18.470210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:18.470656 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.472385 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:18.472836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:18.619862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:18.627483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ab91915c-a2a9-46e8-b6ca-afa38a9d2ca8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.169076 Jun 17 07:26:18.628049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 427/829] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:18 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:18.830553 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c882da32-2a28-4fae-bd14-48d6445290d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.102755 Jun 17 07:26:18.832389 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 403/830] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:26:17 2022] POST /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:19.033224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:19.033929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:19.041092 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.041536 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.042432 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.042920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.176801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:19.186608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-37ee43fc-2bb3-4836-8cd2-a09a44d0fccd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.156718 Jun 17 07:26:19.187458 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 428/831] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:19 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:19.206075 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:19.206794 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:19.213274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.213732 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.214642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.215052 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.411483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:19.419691 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:19.421986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:19.423149 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b85c0806-e1d1-473a-b7a9-b1d5d8369914 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.222772 Jun 17 07:26:19.423713 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 404/832] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:19 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:19.643983 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:19.644663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:19.650748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.651189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.651937 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.652391 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.800802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:19.811604 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3d50f3e5-26bb-4016-b96f-5450de8353d0 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.171765 Jun 17 07:26:19.812203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 429/833] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:19 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:19.971339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:19.973136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:19.980387 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.980829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:19.981594 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:19.982027 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.011372 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-98c85f3b-cec9-444c-b54b-d33a28bd66a8 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044744 Jun 17 07:26:20.011908 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 405/834] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:26:19 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:26:20.116806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.117808 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.124452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.124900 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.125667 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.126098 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.158427 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-43d6fa68-dfa7-4d33-9783-03e3a8605a05 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045436 Jun 17 07:26:20.158918 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 430/835] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:26:20 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:26:20.210459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.211594 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.223025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.223337 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.223834 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.224265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.225819 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.226606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.232390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.233100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.235444 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.235902 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.261888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:26:20.370437 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a4eac559-6284-4030-bb48-bc32e56c64b1 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 204 len: 0 microversion: 2.1 time: 0.150265 Jun 17 07:26:20.371725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 431/836] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:26:20 2022] DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:26:20.385908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.392118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.403467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.405254 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.406384 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.407208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.458186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:20.466621 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:20.484618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e29c4a49-ae2c-459a-a28a-5e80e5b52c02 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.282594 Jun 17 07:26:20.485934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 406/837] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:20 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:20.511507 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.512338 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.521462 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.522158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.522958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.523440 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.619919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:20.628752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b4f72156-4708-4ef2-97d2-2d93cef3ef9e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1672 microversion: 2.1 time: 0.252321 Jun 17 07:26:20.629349 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 432/838] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:20 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:20.727636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:20.737571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:20.739071 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:20.740315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-30df3d9c-428d-4bda-8572-bfb3ebe737d1 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.238144 Jun 17 07:26:20.740874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 407/839] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:20 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:20.828734 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:20.829377 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:20.835811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.836296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:20.837080 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:20.837518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.029927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.041764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f48ebbd0-fca4-4db3-beac-a95906925b4f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.216960 Jun 17 07:26:21.042347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 433/840] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:20 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:21.517511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:21.518126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:21.524993 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.525439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.526204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.526637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.655368 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:21.655970 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:21.662894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.663345 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.664168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.664607 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.683019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.691295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-62c45112-dbd1-4904-aaab-4d1ca582ac55 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.177442 Jun 17 07:26:21.691877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 408/841] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:21 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:21.759802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:21.760499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:21.767329 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.767775 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.768632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:21.769070 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:21.811510 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.819294 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0f61035c-73e0-428d-9f15-0ee966cb9f90 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1672 microversion: 2.1 time: 0.170124 Jun 17 07:26:21.819868 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 434/842] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:21 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:21.912347 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.921969 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.923460 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:21.924709 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-34688ad2-89f8-495d-93cc-59ad291501eb tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.168902 Jun 17 07:26:21.926201 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 409/843] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:21 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:26:22.058777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:22.059462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:22.066193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.066641 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.067480 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.067855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.231883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:22.240728 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d62cc764-c134-4c8b-a6b8-c9ff10c0b1c7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.185403 Jun 17 07:26:22.241404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 435/844] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:22 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:22.330670 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-2d0be796-23f3-4880-b7e7-279d18b031cb req-06d97c64-0e4e-4972-b9a8-0358d141bf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "name": "network-vif-plugged", "status": "completed", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:22.343773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-2d0be796-23f3-4880-b7e7-279d18b031cb req-06d97c64-0e4e-4972-b9a8-0358d141bf7c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.344414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-2d0be796-23f3-4880-b7e7-279d18b031cb req-06d97c64-0e4e-4972-b9a8-0358d141bf7c service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.360792 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-2d0be796-23f3-4880-b7e7-279d18b031cb req-06d97c64-0e4e-4972-b9a8-0358d141bf7c service nova] Creating event network-vif-plugged:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:26:22.369101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-2d0be796-23f3-4880-b7e7-279d18b031cb req-06d97c64-0e4e-4972-b9a8-0358d141bf7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041701 Jun 17 07:26:22.371026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 410/845] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:22.711056 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:22.712107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:22.725259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.726052 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.727504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.728533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.737174 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:22.837867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:22.839308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:22.847699 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.848257 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.849232 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.849886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.880106 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:22.888258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a5cd6178-5fe4-4e34-874a-ba104fe8d93e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.183157 Jun 17 07:26:22.888833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 436/846] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:22 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:22.943829 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:22.945312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:22.953481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.954142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:22.954946 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:22.955433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.122036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.133454 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.134958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.136149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-85da4e41-4aab-40fe-9074-f48625132daa tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.196933 Jun 17 07:26:23.136709 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 437/847] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:22 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:23.202313 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.215485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c50ba1be-dd5d-4fb8-872c-9fed07f42d06 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1672 microversion: 2.1 time: 0.382070 Jun 17 07:26:23.216113 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 411/848] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:22 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1672 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:23.259460 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:23.260040 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:23.267348 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.267887 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.268768 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.269199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.447059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.456135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-20539e88-b6e8-46d9-82bd-a93f87463365 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1568 microversion: 2.1 time: 0.200625 Jun 17 07:26:23.457212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 438/849] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:23 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:23.473279 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:23.473865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:23.480918 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.481675 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.483061 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.483827 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.595770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e13a0021-9e84-4711-8629-3922fe95f1d4 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "POST /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d/action" status: 202 len: 0 microversion: 2.1 time: 0.126290 Jun 17 07:26:23.599524 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 412/850] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jun 17 07:26:23 2022] POST /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:26:23.606277 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:23.607060 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:23.619229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.619495 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.620280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.620764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.788643 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:23.798585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5a1ac548-0088-42fb-b7db-c256502a530d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1576 microversion: 2.1 time: 0.197523 Jun 17 07:26:23.799105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 439/851] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:23 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:23.906770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:23.908555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:23.943423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.944144 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:23.944971 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:23.945705 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.074580 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-02dc085f-b977-4c58-bdba-c5f244dec83b req-06df3993-0c0f-4bd6-b976-38995962bc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09501bed-6039-46fb-8dd3-6a6fba9865ed", "name": "network-vif-deleted", "tag": "8ad0ac99-8aca-4f10-a23a-7c33706d11e5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:24.087108 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-02dc085f-b977-4c58-bdba-c5f244dec83b req-06df3993-0c0f-4bd6-b976-38995962bc20 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.087546 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-02dc085f-b977-4c58-bdba-c5f244dec83b req-06df3993-0c0f-4bd6-b976-38995962bc20 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.118205 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-02dc085f-b977-4c58-bdba-c5f244dec83b req-06df3993-0c0f-4bd6-b976-38995962bc20 service nova] Creating event network-vif-deleted:8ad0ac99-8aca-4f10-a23a-7c33706d11e5 for instance 09501bed-6039-46fb-8dd3-6a6fba9865ed on hv-cinder-83482 Jun 17 07:26:24.129547 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-02dc085f-b977-4c58-bdba-c5f244dec83b req-06df3993-0c0f-4bd6-b976-38995962bc20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063796 Jun 17 07:26:24.130440 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 440/852] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:24.166299 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:24.167361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:24.182392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.183390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.185421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.187909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.271415 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.284666 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5e616087-928a-4f2a-8ef5-a0c250e570fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.382345 Jun 17 07:26:24.288423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 413/853] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:23 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:24.302655 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:24.305408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:24.322315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.323063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.324044 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.324788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.443309 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ca63f8f8484ddf9d7c72749ba7f482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7deafed6f447faade3e3d8d281617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.457358 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a9021c97-42c4-4906-99fe-cf832dba1f45 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 200 len: 1322 microversion: 2.1 time: 0.166373 Jun 17 07:26:24.460195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 414/854] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:24 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:24.539995 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.556809 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-62db2859-f715-444a-a086-e00d1026cf61 req-18392875-49f8-4b33-872f-dd1434064114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "name": "network-vif-unplugged", "status": "completed", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:24.558629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.561504 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.563885 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-df12abf1-aca0-4d37-9e45-ae21ef511927 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1730 microversion: 2.20 time: 0.404707 Jun 17 07:26:24.566053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-62db2859-f715-444a-a086-e00d1026cf61 req-18392875-49f8-4b33-872f-dd1434064114 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.567028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-62db2859-f715-444a-a086-e00d1026cf61 req-18392875-49f8-4b33-872f-dd1434064114 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.569313 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 441/855] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:24 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1730 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:26:24.587556 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.compute.server_external_events [req-62db2859-f715-444a-a086-e00d1026cf61 req-18392875-49f8-4b33-872f-dd1434064114 service nova] Unable to find a host for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d. Dropping event network-vif-unplugged {{(pid=117395) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 07:26:24.588676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-62db2859-f715-444a-a086-e00d1026cf61 req-18392875-49f8-4b33-872f-dd1434064114 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036433 Jun 17 07:26:24.589797 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 415/856] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 17 07:26:24.817001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:24.817532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:24.825047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.825499 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.832490 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:24.833217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:24.982498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:24.991237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7638d12e-5573-4239-92ec-1951051da9d6 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1516 microversion: 2.1 time: 0.178062 Jun 17 07:26:24.991823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 442/857] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:24 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:25.308635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:25.310022 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:25.323576 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.325053 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.326057 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.326666 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.483270 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:25.484582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:25.494381 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.494879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.496004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.496672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.523147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:25.528588 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:25.531150 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-15e3ebf5-58ad-4be4-ad13-adf828da10e1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.226327 Jun 17 07:26:25.533227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 416/858] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:25 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed HTTP/1.1 Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:26:25.542228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:25.543718 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '09501bed-6039-46fb-8dd3-6a6fba9865ed'} Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:25.544776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:25.546915 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:25.549086 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:25.552845 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-00f0ff5b-fc23-4cf0-9d50-e1656610c41e tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 404 len: 111 microversion: 2.1 time: 0.075144 Jun 17 07:26:25.553770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 443/859] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:25 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:26:25.563980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-98549c37-8d98-46bf-802f-16e3a98da564 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '.version_select at 0x7f8b6d3035e0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:25.586705 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-98549c37-8d98-46bf-802f-16e3a98da564 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476901575" status: 202 len: 0 microversion: 2.1 time: 0.027621 Jun 17 07:26:25.587671 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:25.587906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 417/860] 10.222.0.33 () {58 vars in 1220 bytes} [Fri Jun 17 07:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476901575 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:26:25.588830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:25.597247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.598212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.599180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:25.599817 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:25.804891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:25.813548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:25.815067 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:25.816341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-13fcdf73-3746-4738-8da7-ac74bc890200 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1717 microversion: 2.20 time: 0.235484 Jun 17 07:26:25.816929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 444/861] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:26:25 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1717 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 07:26:26.009463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:26.010195 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:26.017704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:26.018155 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:26.018935 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:26.019379 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:26.227693 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:26.235336 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4086e406-c15a-4423-ace2-dc1d3c553670 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1518 microversion: 2.1 time: 0.229924 Jun 17 07:26:26.235900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 418/862] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:26 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1518 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:26.512236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b1bdf00d-6e4b-4799-835f-5b0fe4de0c34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: .version_select at 0x7f8b6d3f3430>, body: {"keypair": {"name": "tempest-keypair-455796605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBhaSY/tNYxZkSzSEXaA/yHK0NBkLqKkFxR7AqtQ0BmboNOS7VR52yMwCVA6VuzMb3fsGG56i6PGEjHj2vHgvqH9vtfQ23PaJlbWxRdBF3D6BIg8IlbsoyaaTafXtxy0g=="}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:26.537183 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-b1bdf00d-6e4b-4799-835f-5b0fe4de0c34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:26:26.545528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-b1bdf00d-6e4b-4799-835f-5b0fe4de0c34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:26:26.557884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:26.558986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:26.571551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:26.572382 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:26.573755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:26.574531 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:26.595627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b1bdf00d-6e4b-4799-835f-5b0fe4de0c34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087861 Jun 17 07:26:26.596640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 445/863] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:26:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:26.772713 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:26.780911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-64898671-398d-45da-a589-8248088dfec3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.230608 Jun 17 07:26:26.781489 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 419/864] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:26 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:27.253007 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:27.254236 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:27.261993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:27.262492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:27.263459 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:27.264093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:27.491393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:27.506503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0baf7c54-b906-40c2-ace9-14e49a22c9da tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.258075 Jun 17 07:26:27.508163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 446/865] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:27 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:27.797501 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:27.798481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:27.805197 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:27.805637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:27.806436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:27.806875 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:27.964255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:27.972538 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-963b5bdf-d127-434a-9e6c-21c96a9e249b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.179110 Jun 17 07:26:27.973136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 420/866] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:27 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:28.247375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-404564171", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69bdf73b-b655-40e8-99ba-01f63a3ac44d"}], "security_groups": [{"name": "tempest-securitygroup--104737997"}], "key_name": "tempest-keypair-455796605", "user_data": "}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:28.360936 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] validate_networks() for [('69bdf73b-b655-40e8-99ba-01f63a3ac44d', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:26:28.526335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:28.526854 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:28.533785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.534237 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.535046 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.535485 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.704760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:28.712863 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-14730fe6-52ab-4b0f-b346-20d570d5efe8 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.191118 Jun 17 07:26:28.714013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 421/867] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:28 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:28.746368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:28.746891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:28.753634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.754086 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.754859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.755533 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.770836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed HTTP/1.1 Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:26:28.772841 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.774449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '09501bed-6039-46fb-8dd3-6a6fba9865ed'} Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:28.778468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.779901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.782395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:28.782395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0eadd7e4-3919-4b97-8593-7596132808f2 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 404 len: 111 microversion: 2.1 time: 0.031797 Jun 17 07:26:28.782395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 422/868] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:26:28 2022] DELETE /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:28.783133 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:28.783469 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 09501bed-6039-46fb-8dd3-6a6fba9865ed] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:28.789590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.790050 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.790962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.791226 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed HTTP/1.1 Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:26:28.807874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.809873 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '09501bed-6039-46fb-8dd3-6a6fba9865ed'} Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:28.810644 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. Jun 17 07:26:28.812401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:28.813716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 09501bed-6039-46fb-8dd3-6a6fba9865ed could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:28.813716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-04f1d17a-a01c-4e37-90bb-6c5459f91476 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed" status: 404 len: 111 microversion: 2.1 time: 0.030435 Jun 17 07:26:28.813716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 423/869] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:28 2022] GET /compute/v2.1/servers/09501bed-6039-46fb-8dd3-6a6fba9865ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:26:28.846802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:26:28.847227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:26:28.847746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:26:28.848322 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:26:28.848741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:26:28.858357 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.858878 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.859751 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:28.860222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:28.879429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:26:28.884351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:26:28.898644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:26:28.901724 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:26:28.948017 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1765fb83-ab4a-4d7e-b903-14b39ce00da0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.705047 Jun 17 07:26:28.948692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 447/870] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:26:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 07:26:28.959887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-581dfca4-ac5c-4992-ada9-17ecc2cce5a5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:28.960541 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-581dfca4-ac5c-4992-ada9-17ecc2cce5a5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:28.989828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:28.990439 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:29.001823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.002297 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.003102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.003540 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.019482 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-581dfca4-ac5c-4992-ada9-17ecc2cce5a5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:29.027646 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-581dfca4-ac5c-4992-ada9-17ecc2cce5a5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1240 microversion: 2.1 time: 0.071200 Jun 17 07:26:29.032549 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 424/871] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:28 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:29.167426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:29.176606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-086f368c-cda4-47ba-9388-ba4a47624fb5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.190348 Jun 17 07:26:29.177206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 448/872] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:28 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:29.730857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:29.731839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:29.738056 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.738483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.739247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.739681 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.888373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:29.898180 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ad694461-2d91-43d8-b3bc-65793d4757bd tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.171110 Jun 17 07:26:29.898963 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 425/873] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:29 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:29.965289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:29.966307 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:29.977365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.978161 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.979182 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:29.979805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:29.997019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 HTTP/1.1 Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:26:29.998881 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.000948 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '73a8c90c-c561-4193-8276-ae0351b550f4'} Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:30.001693 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.003177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.005433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:30.006453 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a955ae7b-b1d4-48a5-855d-ea149fd453b4 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 404 len: 111 microversion: 2.1 time: 0.048354 Jun 17 07:26:30.007347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 449/874] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:26:29 2022] DELETE /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:30.017936 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:30.018561 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] [instance: 73a8c90c-c561-4193-8276-ae0351b550f4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:30.025851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.026069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.027272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.027930 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.045177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] HTTP exception thrown: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.045740 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Request method failure captured: Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 HTTP/1.1 Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsPThnSO_fLzrOUDcA2ujyffsARQgD8P_7HqEMTgU6_IggeRw65veKXCuCIDH3r0DscyarpsNOCYS-mAGS1B9uf6iXn7B8Oh-TgoqS-T9fPFWgrcLm551U-zmILPOsnc-vGud_3ZTFoYJDk99dtjkyVAAP-DWXSCk_rMUQ5R39yzqo Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:26:30.047119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab7deafed6f447faade3e3d8d281617a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: ab7deafed6f447faade3e3d8d281617a Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeTestJSON-399255042 Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: b3ca63f8f8484ddf9d7c72749ba7f482 Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeTestJSON-399255042-project Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.048749 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '73a8c90c-c561-4193-8276-ae0351b550f4'} Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:30.049682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. Jun 17 07:26:30.051100 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:30.052467 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:30.053399 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] Returning 404 to user: Instance 73a8c90c-c561-4193-8276-ae0351b550f4 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:30.054444 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3276165d-3a07-43bd-88f7-a1bcba7696b0 tempest-AttachVolumeTestJSON-399255042 tempest-AttachVolumeTestJSON-399255042-project] 10.222.0.33 "GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4" status: 404 len: 111 microversion: 2.1 time: 0.040725 Jun 17 07:26:30.055661 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 426/875] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:30 2022] GET /compute/v2.1/servers/73a8c90c-c561-4193-8276-ae0351b550f4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:30.057579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.058378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.059483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.059900 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.195937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:30.197760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:30.213593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.214436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.215774 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.216724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.318482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:30.326104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e2036f70-c0c3-47a6-a2d8-fe6176d094f1 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1298 microversion: 2.1 time: 0.285384 Jun 17 07:26:30.335990 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 450/876] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:30 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1298 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:30.448926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:30.458136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:30.459160 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-921a9e84-191e-489d-83cc-36302022f591 req-3cd7abdf-4be2-4765-997b-92d3ccc4fa31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47fec78-0275-4db6-a345-a4999f2863b4", "name": "network-vif-plugged", "status": "completed", "tag": "f987d351-5531-4e29-9020-013999acc4e6"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:30.471761 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d8532ab0-b6f9-454e-b84e-684da5b3a668 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.280632 Jun 17 07:26:30.485678 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 427/877] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:30 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:30.498244 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-921a9e84-191e-489d-83cc-36302022f591 req-3cd7abdf-4be2-4765-997b-92d3ccc4fa31 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.499035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-921a9e84-191e-489d-83cc-36302022f591 req-3cd7abdf-4be2-4765-997b-92d3ccc4fa31 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.523473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-921a9e84-191e-489d-83cc-36302022f591 req-3cd7abdf-4be2-4765-997b-92d3ccc4fa31 service nova] Creating event network-vif-plugged:f987d351-5531-4e29-9020-013999acc4e6 for instance d47fec78-0275-4db6-a345-a4999f2863b4 on hv-cinder-83482 Jun 17 07:26:30.533405 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-921a9e84-191e-489d-83cc-36302022f591 req-3cd7abdf-4be2-4765-997b-92d3ccc4fa31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081620 Jun 17 07:26:30.535839 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 451/878] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:30.918278 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:30.919190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:30.927840 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.928640 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:30.930480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:30.931156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:31.133380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:31.142837 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-66551899-6beb-4188-a10a-8de5efb274a9 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.229141 Jun 17 07:26:31.154384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 428/879] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:30 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:31.347691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:31.349107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:31.361912 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:31.362347 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:31.363705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:31.363705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:31.500109 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:31.500804 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:31.508120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:31.509302 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:31.510341 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:31.510960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:31.847618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:31.856221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5f6888c8-88f5-4537-8c46-956e285643d5 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1267 microversion: 2.1 time: 0.361084 Jun 17 07:26:31.866227 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 429/880] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:31 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:31.932635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:31.944752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c2f44cf6-2df9-46c1-acf8-61b9155a93fa tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.603425 Jun 17 07:26:31.951563 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 452/881] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:31 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:32.161397 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:32.162791 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:32.170977 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.171743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.172762 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.173231 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.226027 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-fdff84ba-ac9e-49e3-bb3f-7b840269085c req-eea50362-9fa5-43be-a641-b4223b133227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0db5765-c86f-4fac-9e92-ac1ff1147709", "tag": "33826e23-a394-46bb-a05a-72936c98c2a5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:32.244809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-fdff84ba-ac9e-49e3-bb3f-7b840269085c req-eea50362-9fa5-43be-a641-b4223b133227 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.245392 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-fdff84ba-ac9e-49e3-bb3f-7b840269085c req-eea50362-9fa5-43be-a641-b4223b133227 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.267464 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-fdff84ba-ac9e-49e3-bb3f-7b840269085c req-eea50362-9fa5-43be-a641-b4223b133227 service nova] Creating event network-changed:33826e23-a394-46bb-a05a-72936c98c2a5 for instance c0db5765-c86f-4fac-9e92-ac1ff1147709 on hv-cinder-83482 Jun 17 07:26:32.283994 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-fdff84ba-ac9e-49e3-bb3f-7b840269085c req-eea50362-9fa5-43be-a641-b4223b133227 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062251 Jun 17 07:26:32.284568 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 453/882] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:32.433450 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:32.445706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d6e0d842-0bea-413a-b37c-0358df44f380 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.288971 Jun 17 07:26:32.453624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 430/883] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:32 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:32.875155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:32.876487 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:32.884411 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.885081 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.886042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.886642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.970989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:32.971704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:32.978331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.978874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:32.979667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:32.980194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:33.144254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:33.153158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:33.167314 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cad73410-2315-4844-b591-7ea64d35af1b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.200340 Jun 17 07:26:33.168250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 431/884] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:32 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:33.178608 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b4280b5e-8ec3-4f8b-aaaa-17241cf6efa4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1453 microversion: 2.1 time: 0.308269 Jun 17 07:26:33.179330 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 454/885] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:32 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1453 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:33.197021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:33.198157 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:33.208976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:33.209667 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:33.210739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:33.211333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:33.368575 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:33.376574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e9d58dda-cdd8-4dba-9985-9d3384dbe382 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1453 microversion: 2.1 time: 0.184946 Jun 17 07:26:33.377148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 432/886] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:33 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:33.462968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:33.464096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:33.471273 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:33.471273 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:33.473288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:33.473288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:33.722409 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:33.759229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2e6f7d45-2708-4547-89f2-a8d7d68686be tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.299801 Jun 17 07:26:33.771830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 455/887] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:33 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:34.186036 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:34.187793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:34.194255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:34.194948 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:34.195938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:34.196551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:34.502698 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:34.518991 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-882e9f75-ab04-469d-83a3-38d893b917d7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.337589 Jun 17 07:26:34.519804 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 433/888] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:34 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:34.782237 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:34.782993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:34.793688 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:34.794858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:34.795914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:34.797356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:34.995493 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:35.005074 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5857c9b3-8451-4684-b990-4fdafa3b6d86 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.227628 Jun 17 07:26:35.005956 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 456/889] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:34 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:35.538160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:35.539496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:35.548447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:35.549202 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:35.550128 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:35.550783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:35.807507 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:35.815630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5a1b461b-e04e-4d49-8540-d4cc4ce01c21 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.281810 Jun 17 07:26:35.816228 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 434/890] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:35 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:36.013504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-ff765c8e-8a9d-41de-b235-22528c485994 req-73a52822-138f-449f-bef7-7470cbcfdb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47fec78-0275-4db6-a345-a4999f2863b4", "tag": "f987d351-5531-4e29-9020-013999acc4e6"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:36.025368 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-ff765c8e-8a9d-41de-b235-22528c485994 req-73a52822-138f-449f-bef7-7470cbcfdb59 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.026174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-ff765c8e-8a9d-41de-b235-22528c485994 req-73a52822-138f-449f-bef7-7470cbcfdb59 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:36.040847 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-ff765c8e-8a9d-41de-b235-22528c485994 req-73a52822-138f-449f-bef7-7470cbcfdb59 service nova] Creating event network-changed:f987d351-5531-4e29-9020-013999acc4e6 for instance d47fec78-0275-4db6-a345-a4999f2863b4 on hv-cinder-83482 Jun 17 07:26:36.047025 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-ff765c8e-8a9d-41de-b235-22528c485994 req-73a52822-138f-449f-bef7-7470cbcfdb59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038882 Jun 17 07:26:36.047714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 435/891] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:36.054775 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:36.055690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:36.063362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.063920 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:36.064898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.065748 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:36.149658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8dcd08ea-777d-4a07-a69a-6ecf786b933c tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Action: 'create', calling method: .version_select at 0x7f8b6d44dd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1406139333"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:36.351494 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:36.369408 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-771125a6-1c43-4219-b8ab-653cae03fe3c tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.317980 Jun 17 07:26:36.370448 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 436/892] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:36 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:36.611334 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-a864bb86-fd14-47d7-9401-b6ab9645b652 req-e87d1c3c-b459-44a4-9963-63927c5d8581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "name": "network-vif-plugged", "status": "completed", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:36.648252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a864bb86-fd14-47d7-9401-b6ab9645b652 req-e87d1c3c-b459-44a4-9963-63927c5d8581 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.648939 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-a864bb86-fd14-47d7-9401-b6ab9645b652 req-e87d1c3c-b459-44a4-9963-63927c5d8581 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:36.690008 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-a864bb86-fd14-47d7-9401-b6ab9645b652 req-e87d1c3c-b459-44a4-9963-63927c5d8581 service nova] Creating event network-vif-plugged:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:26:36.737733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-a864bb86-fd14-47d7-9401-b6ab9645b652 req-e87d1c3c-b459-44a4-9963-63927c5d8581 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151227 Jun 17 07:26:36.740683 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 437/893] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:36.761318 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8dcd08ea-777d-4a07-a69a-6ecf786b933c tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.754797 Jun 17 07:26:36.762091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 457/894] 10.222.0.33 () {60 vars in 1154 bytes} [Fri Jun 17 07:26:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 756 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 07:26:36.774380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b819935b-776b-4131-a97e-03905f8e56c7 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d5c0280>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:36.831471 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b819935b-776b-4131-a97e-03905f8e56c7 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 200 len: 345 microversion: 2.1 time: 0.061560 Jun 17 07:26:36.832313 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 438/895] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:26:36 2022] GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:36.837747 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:36.837747 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:36.845326 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.845911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:36.847149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:36.847659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:37.012088 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:37.020262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=100 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:37.030107 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-af093352-d0c7-4030-9736-53195c2b53b4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.198883 Jun 17 07:26:37.031913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 458/896] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:36 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:37.389695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:37.391013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:37.405311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:37.405760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:37.406548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:37.407174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:37.552554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:37.560307 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0905fcbd-d2b3-41d9-be29-23b3499fd146 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.177113 Jun 17 07:26:37.560900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 439/897] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:37 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:37.844960 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-392059d2-1247-4515-8066-8f83db96b1c0 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d44d430>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:37.896764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-392059d2-1247-4515-8066-8f83db96b1c0 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 200 len: 346 microversion: 2.1 time: 0.056173 Jun 17 07:26:37.897333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 459/898] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:26:37 2022] GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:37.908949 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-62326ccd-dbd3-4163-a74c-ad24943d6a44 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Action: 'create', calling method: .version_select at 0x7f8b6d437790>, body: {"snapshot": {"volume_id": "60be1a3e-c727-41ba-9b16-9a08b19823c1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-403323622"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:38.050927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:38.051815 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:38.054773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:38.060617 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:38.061064 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:38.061833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:38.062268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:38.073282 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-62326ccd-dbd3-4163-a74c-ad24943d6a44 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.168671 Jun 17 07:26:38.073875 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 440/899] 10.222.0.33 () {60 vars in 1161 bytes} [Fri Jun 17 07:26:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:38.087137 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-228accab-c88d-4fc6-8958-0ed0c348c610 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d559160>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:38.119160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-228accab-c88d-4fc6-8958-0ed0c348c610 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 286 microversion: 2.1 time: 0.038479 Jun 17 07:26:38.120196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 441/900] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:38 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:38.134898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-74ce2a7e-4076-4175-a500-c1c64f6d954c tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d5e0c10>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:38.173979 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-74ce2a7e-4076-4175-a500-c1c64f6d954c tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.045377 Jun 17 07:26:38.174752 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 442/901] 10.222.0.33 () {58 vars in 1139 bytes} [Fri Jun 17 07:26:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:38.186944 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7f881006-e588-4c88-883a-4097f3646e2a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d5595e0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:38.224096 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7f881006-e588-4c88-883a-4097f3646e2a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 286 microversion: 2.1 time: 0.041042 Jun 17 07:26:38.226966 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:38.229384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 443/902] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:38 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:26:38.237925 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-35cfd2db-822e-4e30-a1c7-75fd0652d1d0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.193646 Jun 17 07:26:38.238491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 460/903] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:38 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:38.580171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:38.580879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:38.583162 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:38.589804 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:38.590311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:38.591217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:38.591716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:38.731849 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:38.740562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d6cee8c0-ab43-441f-8fe0-3bc529bcf492 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.166101 Jun 17 07:26:38.741237 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 444/904] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:38 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:38.755987 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-367bdd7d-3ae4-4cc2-afd8-cf47c23faa6d req-7940c252-2915-4535-8fba-969c600cb143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0db5765-c86f-4fac-9e92-ac1ff1147709", "name": "network-vif-plugged", "status": "completed", "tag": "33826e23-a394-46bb-a05a-72936c98c2a5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:38.768649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-367bdd7d-3ae4-4cc2-afd8-cf47c23faa6d req-7940c252-2915-4535-8fba-969c600cb143 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:38.768649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-367bdd7d-3ae4-4cc2-afd8-cf47c23faa6d req-7940c252-2915-4535-8fba-969c600cb143 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:38.781135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-367bdd7d-3ae4-4cc2-afd8-cf47c23faa6d req-7940c252-2915-4535-8fba-969c600cb143 service nova] Creating event network-vif-plugged:33826e23-a394-46bb-a05a-72936c98c2a5 for instance c0db5765-c86f-4fac-9e92-ac1ff1147709 on hv-cinder-83482 Jun 17 07:26:38.786068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-367bdd7d-3ae4-4cc2-afd8-cf47c23faa6d req-7940c252-2915-4535-8fba-969c600cb143 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jun 17 07:26:38.786684 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 461/905] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:39.238376 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4b32f4e7-7541-4471-bcb3-9ef401e1ee66 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d54f940>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:39.245879 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:39.256255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:39.257410 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=10 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:26:39.262476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:39.263177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:39.272809 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4b32f4e7-7541-4471-bcb3-9ef401e1ee66 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 286 microversion: 2.1 time: 0.039456 Jun 17 07:26:39.273479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 445/906] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:39 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:39.278180 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:39.278640 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:39.279426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:39.279861 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:39.432698 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:39.440919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-31eaeae3-50f9-48cd-9c2b-1c080199cb70 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.185754 Jun 17 07:26:39.441519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 462/907] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:39 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:39.761504 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:39.762148 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:39.768652 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:39.769135 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:39.769954 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:39.770428 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:39.915152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:39.923842 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a65c9c88-6021-451e-aaa2-45a5c6a22141 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.166294 Jun 17 07:26:39.924464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 446/908] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:39 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:40.285380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-039fbf9c-420a-4bf3-a2c3-c550cde96f9f tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d704550>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:40.317338 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-039fbf9c-420a-4bf3-a2c3-c550cde96f9f tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 286 microversion: 2.1 time: 0.036299 Jun 17 07:26:40.317914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 463/909] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:40 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:40.459410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:40.460019 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:40.467030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:40.467480 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:40.468851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:40.469294 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:40.605449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:40.613194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-cacb0c97-6763-4da7-abec-e28a0361d5d8 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.157789 Jun 17 07:26:40.613768 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 447/910] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:40 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:40.942099 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:40.942711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:40.948930 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:40.949370 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:40.950131 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:40.950564 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:41.094613 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:41.102863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2d0ff941-52ef-40f3-bb79-3ff71c3fdeb7 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1574 microversion: 2.1 time: 0.164915 Jun 17 07:26:41.103465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 464/911] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:40 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:41.329154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e88ce52d-7a2c-4065-8cba-93d3d3d93555 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d692af0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:41.359194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e88ce52d-7a2c-4065-8cba-93d3d3d93555 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 287 microversion: 2.1 time: 0.033443 Jun 17 07:26:41.360709 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 448/912] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:41 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:41.371365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-294bdd4b-da82-443e-84e8-1f76426ed9bb tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d39d280>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:41.439356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-294bdd4b-da82-443e-84e8-1f76426ed9bb tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 202 len: 0 microversion: 2.1 time: 0.071832 Jun 17 07:26:41.440058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 465/913] 10.222.0.33 () {58 vars in 1253 bytes} [Fri Jun 17 07:26:41 2022] DELETE /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 07:26:41.449424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c8f2945f-b0e0-4e58-82bb-7ba7e63d57d8 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d5e0dc0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:41.481429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c8f2945f-b0e0-4e58-82bb-7ba7e63d57d8 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 200 len: 286 microversion: 2.1 time: 0.036916 Jun 17 07:26:41.482068 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 449/914] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:41 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:41.631360 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:41.631953 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:41.639407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:41.639892 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:41.640823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:41.641371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:41.776119 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:41.784646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d244acd0-06f5-4992-a790-8d7f67e559c4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.158137 Jun 17 07:26:41.785253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 466/915] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:41 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:42.121836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:42.122438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:42.129101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:42.129545 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:42.130306 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:42.130734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:42.279771 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:42.288151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bca321da-3e1b-40af-b539-d4cae31b6fef tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1561 microversion: 2.1 time: 0.170154 Jun 17 07:26:42.288788 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 450/916] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:42 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:42.494809 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d26cd66-1ee6-4d8c-9100-4734762b4c3a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d39d820>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:42.521954 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-6d26cd66-1ee6-4d8c-9100-4734762b4c3a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] HTTP exception thrown: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d26cd66-1ee6-4d8c-9100-4734762b4c3a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Request method failure captured: Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f HTTP/1.1 Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCyrKKzI-V9Ws5EKEKvl0y7PXQQEQQE-so7MKqbgmchV08ZnPQxSbo8IdBrhSCKgGH5FFYSQFyDhrcz_Dv6mNSbWXWTqwf5zSYmK5U91SrDYWc1G7yyUbYTPG3DTy-fwqucEG45Vbub70UhmBogFenDaAigmfavf0KnKPngYK0LNhJs Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:26:42.524404 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5353209c2aa1438ea797961407c2d31b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6d980acea00944bd89ad3d727c031ac9 Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '54a1338a-67a2-47ac-b9e2-0b9b7e6e496f'} Jun 17 07:26:42.526102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. (HTTP 404) (Request-ID: req-592c4351-6c83-487f-ba29-19af5e0854c4) Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.527114 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:42.528632 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 07:26:42.530465 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6d26cd66-1ee6-4d8c-9100-4734762b4c3a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Returning 404 to user: Snapshot 54a1338a-67a2-47ac-b9e2-0b9b7e6e496f could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6d26cd66-1ee6-4d8c-9100-4734762b4c3a tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f" status: 404 len: 111 microversion: 2.1 time: 0.035570 Jun 17 07:26:42.532176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 467/917] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:26:42 2022] GET /compute/v2.1/os-snapshots/54a1338a-67a2-47ac-b9e2-0b9b7e6e496f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:42.535838 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-738a1ff5-a94f-4b13-a30b-a00dfc98e679 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d616790>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:42.603149 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-738a1ff5-a94f-4b13-a30b-a00dfc98e679 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 202 len: 0 microversion: 2.1 time: 0.071915 Jun 17 07:26:42.604045 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 451/918] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:26:42 2022] DELETE /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:26:42.614559 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8dcfb58c-3341-4578-b47c-6c9edcf2dc3d tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d35a040>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:42.672015 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8dcfb58c-3341-4578-b47c-6c9edcf2dc3d tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 200 len: 345 microversion: 2.1 time: 0.061543 Jun 17 07:26:42.672941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 468/919] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:26:42 2022] GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:42.804769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:42.805471 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:42.811451 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:42.812704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:42.813816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:42.814255 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:42.951113 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:42.960250 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1632d3f6-8241-405b-b42b-146c33768126 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1365 microversion: 2.1 time: 0.160291 Jun 17 07:26:42.960822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 452/920] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:42 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:26:43.687943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d80f15ba-259a-4722-9e46-52da5eb56814 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d39d0d0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:43.716314 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-d80f15ba-259a-4722-9e46-52da5eb56814 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] HTTP exception thrown: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d80f15ba-259a-4722-9e46-52da5eb56814 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Request method failure captured: Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 HTTP/1.1 Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCyrKKzI-V9Ws5EKEKvl0y7PXQQEQQE-so7MKqbgmchV08ZnPQxSbo8IdBrhSCKgGH5FFYSQFyDhrcz_Dv6mNSbWXWTqwf5zSYmK5U91SrDYWc1G7yyUbYTPG3DTy-fwqucEG45Vbub70UhmBogFenDaAigmfavf0KnKPngYK0LNhJs Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:26:43.718282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5353209c2aa1438ea797961407c2d31b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6d980acea00944bd89ad3d727c031ac9 Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '60be1a3e-c727-41ba-9b16-9a08b19823c1'} Jun 17 07:26:43.720014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. (HTTP 404) (Request-ID: req-8e5ddecc-2a81-4e63-ad01-9c2c895f86bf) Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.720967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:43.722278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:26:43.723512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d80f15ba-259a-4722-9e46-52da5eb56814 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Returning 404 to user: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d80f15ba-259a-4722-9e46-52da5eb56814 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 404 len: 109 microversion: 2.1 time: 0.036803 Jun 17 07:26:43.725083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 469/921] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:26:43 2022] GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:43.738851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c3eef463-b6f7-4a71-b9e0-7799b5fea59e tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d54f940>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:43.775119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-c3eef463-b6f7-4a71-b9e0-7799b5fea59e tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] HTTP exception thrown: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c3eef463-b6f7-4a71-b9e0-7799b5fea59e tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Request method failure captured: Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 HTTP/1.1 Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCyrKKzI-V9Ws5EKEKvl0y7PXQQEQQE-so7MKqbgmchV08ZnPQxSbo8IdBrhSCKgGH5FFYSQFyDhrcz_Dv6mNSbWXWTqwf5zSYmK5U91SrDYWc1G7yyUbYTPG3DTy-fwqucEG45Vbub70UhmBogFenDaAigmfavf0KnKPngYK0LNhJs Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:26:43.777737 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5353209c2aa1438ea797961407c2d31b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 6d980acea00944bd89ad3d727c031ac9 Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '60be1a3e-c727-41ba-9b16-9a08b19823c1'} Jun 17 07:26:43.779416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. (HTTP 404) (Request-ID: req-531eb519-5040-4bb9-8b63-65ea4a795ace) Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.780385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 07:26:43.781856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 07:26:43.783212 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c3eef463-b6f7-4a71-b9e0-7799b5fea59e tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Returning 404 to user: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c3eef463-b6f7-4a71-b9e0-7799b5fea59e tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 404 len: 109 microversion: 2.1 time: 0.044501 Jun 17 07:26:43.784627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 453/922] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:26:43 2022] DELETE /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:43.792091 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6b3c88b1-2a1d-48fc-8003-6e938d77b4b4 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Calling method '.version_select at 0x7f8b6d47b310>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:43.823530 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-6b3c88b1-2a1d-48fc-8003-6e938d77b4b4 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] HTTP exception thrown: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6b3c88b1-2a1d-48fc-8003-6e938d77b4b4 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Request method failure captured: Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 HTTP/1.1 Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCyrKKzI-V9Ws5EKEKvl0y7PXQQEQQE-so7MKqbgmchV08ZnPQxSbo8IdBrhSCKgGH5FFYSQFyDhrcz_Dv6mNSbWXWTqwf5zSYmK5U91SrDYWc1G7yyUbYTPG3DTy-fwqucEG45Vbub70UhmBogFenDaAigmfavf0KnKPngYK0LNhJs Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:26:43.825566 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5353209c2aa1438ea797961407c2d31b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5353209c2aa1438ea797961407c2d31b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 5353209c2aa1438ea797961407c2d31b Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-247874712 Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6d980acea00944bd89ad3d727c031ac9 Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-VolumesSnapshotsTestJSON-247874712-project Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '60be1a3e-c727-41ba-9b16-9a08b19823c1'} Jun 17 07:26:43.828870 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. (HTTP 404) (Request-ID: req-a734de24-3ee1-433f-b94b-2c76c6159942) Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.830696 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 07:26:43.832715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 07:26:43.834378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6b3c88b1-2a1d-48fc-8003-6e938d77b4b4 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] Returning 404 to user: Volume 60be1a3e-c727-41ba-9b16-9a08b19823c1 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6b3c88b1-2a1d-48fc-8003-6e938d77b4b4 tempest-VolumesSnapshotsTestJSON-247874712 tempest-VolumesSnapshotsTestJSON-247874712-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1" status: 404 len: 109 microversion: 2.1 time: 0.038941 Jun 17 07:26:43.836927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 470/923] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:26:43 2022] GET /compute/v2.1/os-volumes/60be1a3e-c727-41ba-9b16-9a08b19823c1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:26:43.982414 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:43.983246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:43.992968 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:43.993960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:43.995234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:43.995980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:44.139143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:26:44.147756 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-779c8043-771b-4401-8821-0d7d0c78adf9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1555 microversion: 2.1 time: 0.169740 Jun 17 07:26:44.148444 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 454/924] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:26:43 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:26:44.166149 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:26:44.166650 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:26:44.174275 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:44.174869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:44.175789 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:44.176324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:44.276103 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-82781d21-85c3-4902-94c0-dbeabc0f1d24 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113679 Jun 17 07:26:44.277012 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 471/925] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:26:44 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:26:45.732324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-0e318bee-5f9c-4b05-b521-b089f3e0c332 req-0ec7ddf5-a410-4972-89f1-a415e535cd66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0db5765-c86f-4fac-9e92-ac1ff1147709", "tag": "33826e23-a394-46bb-a05a-72936c98c2a5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:26:45.745265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-0e318bee-5f9c-4b05-b521-b089f3e0c332 req-0ec7ddf5-a410-4972-89f1-a415e535cd66 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:26:45.746120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-0e318bee-5f9c-4b05-b521-b089f3e0c332 req-0ec7ddf5-a410-4972-89f1-a415e535cd66 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:26:45.769028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-0e318bee-5f9c-4b05-b521-b089f3e0c332 req-0ec7ddf5-a410-4972-89f1-a415e535cd66 service nova] Creating event network-changed:33826e23-a394-46bb-a05a-72936c98c2a5 for instance c0db5765-c86f-4fac-9e92-ac1ff1147709 on hv-cinder-83482 Jun 17 07:26:45.777964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-0e318bee-5f9c-4b05-b521-b089f3e0c332 req-0ec7ddf5-a410-4972-89f1-a415e535cd66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049937 Jun 17 07:26:45.780170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 455/926] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:27:04.624781 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=11 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:04.625538 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=30 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:04.629601 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:04.630620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:04.637539 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.638009 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:04.638777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.639217 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:04.671992 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-aa31a543-8cdd-439e-a3ea-a910a1049c83 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048669 Jun 17 07:27:04.672865 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 472/927] 10.222.0.33 () {60 vars in 1342 bytes} [Fri Jun 17 07:27:04 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:04.743613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:04.744265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:04.746999 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=13 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:04.747642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=97 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:04.754075 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.754523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:04.755308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.755742 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:04.782746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:27:04.869820 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-97286a45-84f1-4fa1-bd40-3216a310d84b tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 204 len: 0 microversion: 2.20 time: 0.130897 Jun 17 07:27:04.870424 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 456/928] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Jun 17 07:27:04 2022] DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:27:04.878907 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:04.879510 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:04.885759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.886211 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:04.886980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:04.887419 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:05.024514 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:05.033541 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:05.035303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:05.036524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5f4ea875-446b-4b07-9ca5-2b21144a7482 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.161824 Jun 17 07:27:05.037168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 473/929] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:04 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:06.055177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:06.055889 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:06.063274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:06.063758 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:06.064833 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:06.065278 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:06.209281 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:06.217704 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:06.219321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:06.220461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-86018562-f423-4317-8f5c-c4c19151431d tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1723 microversion: 2.20 time: 0.169626 Jun 17 07:27:06.221078 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 457/930] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:06 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:07.243182 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:07.243872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:07.250527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:07.251057 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:07.251967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:07.253189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:07.334961 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:07.343211 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:07.344748 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e94cc1c6a743ce898424ad7ba26cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277f81ef9ed74a6189221440edd53d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:07.345920 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ad93d00a-a729-4ffe-81b2-4bfc370824c4 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 200 len: 1656 microversion: 2.20 time: 0.108283 Jun 17 07:27:07.346474 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 474/931] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:07 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 1656 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 07:27:07.520518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-6aeeaa05-dd3a-433e-b2b9-60659dc35d1f req-75430ad8-615f-4999-a803-dac31363eac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22260155-f09d-4ea1-aa32-ec3a3e2c5c74", "name": "network-vif-deleted", "tag": "dba1d1a8-9ccb-4208-8f53-aedafc10079e"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:07.529545 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6aeeaa05-dd3a-433e-b2b9-60659dc35d1f req-75430ad8-615f-4999-a803-dac31363eac8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:07.529989 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-6aeeaa05-dd3a-433e-b2b9-60659dc35d1f req-75430ad8-615f-4999-a803-dac31363eac8 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:07.542254 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-6aeeaa05-dd3a-433e-b2b9-60659dc35d1f req-75430ad8-615f-4999-a803-dac31363eac8 service nova] Creating event network-vif-deleted:dba1d1a8-9ccb-4208-8f53-aedafc10079e for instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 on hv-cinder-83482 Jun 17 07:27:07.547663 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-6aeeaa05-dd3a-433e-b2b9-60659dc35d1f req-75430ad8-615f-4999-a803-dac31363eac8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Jun 17 07:27:07.548527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 458/932] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:08.364367 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:08.365191 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:08.375321 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:08.376036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:08.376584 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:08.377022 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:08.391932 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 HTTP/1.1 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:08.393542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:08.395058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '22260155-f09d-4ea1-aa32-ec3a3e2c5c74'} Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:08.396010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:08.397805 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:08.399433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:08.399433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-544ffd03-da5b-4c0e-850b-657581c985af tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 404 len: 111 microversion: 2.20 time: 0.034809 Jun 17 07:27:08.399433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 475/933] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:08 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:08.405643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7ddd0150-e365-44cd-8c4b-2303eef46731 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '.version_select at 0x7f8b6d5e0c10>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:08.426129 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7ddd0150-e365-44cd-8c4b-2303eef46731 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030533923" status: 204 len: 0 microversion: 2.20 time: 0.024929 Jun 17 07:27:08.426730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 459/934] 10.222.0.33 () {60 vars in 1261 bytes} [Fri Jun 17 07:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030533923 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 07:27:12.282168 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:12.282657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:12.289565 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:12.290014 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:12.291094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:12.291532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:12.306609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 HTTP/1.1 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:12.308687 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.310274 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '22260155-f09d-4ea1-aa32-ec3a3e2c5c74'} Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:12.311068 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.312904 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.314178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:12.314178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1bef67a5-ce5f-45c0-9231-2e50db09a146 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 404 len: 111 microversion: 2.20 time: 0.032316 Jun 17 07:27:12.314178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 476/935] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Jun 17 07:27:12 2022] DELETE /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:12.319587 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:12.320345 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 22260155-f09d-4ea1-aa32-ec3a3e2c5c74] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:12.326527 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:12.326970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:12.327762 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:12.328773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:12.344624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 HTTP/1.1 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:27:12.346243 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.348393 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '22260155-f09d-4ea1-aa32-ec3a3e2c5c74'} Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:12.349333 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. Jun 17 07:27:12.350851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:12.352260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 22260155-f09d-4ea1-aa32-ec3a3e2c5c74 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:12.352260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4cf98458-e21b-4a5d-be03-93bece3c9be2 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74" status: 404 len: 111 microversion: 2.20 time: 0.032037 Jun 17 07:27:12.352260 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 460/936] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:12 2022] GET /compute/v2.1/servers/22260155-f09d-4ea1-aa32-ec3a3e2c5c74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:15.582333 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:15.582831 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:15.589831 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:15.590280 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:15.591053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:15.591485 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:15.605789 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b HTTP/1.1 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:15.607364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.609618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '029b110f-b393-4f26-a564-bc4c10ce744b'} Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:15.610600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.612123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.613922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:15.613922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-f73fbcf0-6d12-4cd3-8fb5-44fe90be1754 tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 404 len: 111 microversion: 2.20 time: 0.030360 Jun 17 07:27:15.613922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 477/937] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Jun 17 07:27:15 2022] DELETE /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:15.617922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:15.618534 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] [instance: 029b110f-b393-4f26-a564-bc4c10ce744b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:15.625978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:15.626431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:15.627203 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:15.627643 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:15.642066 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] HTTP exception thrown: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Request method failure captured: Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b HTTP/1.1 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCsb-SIE7eO0FnM78Tsmr4-hAkuQFTncLvzwZnD_7_W2xv-li9YdBuvYwqVIWDA5WjOzqHLzx2E3IJc_RnIdXgGhRZL8-yOKIgIJL3P8PpFRGfAqxVFkCz6N7ZHayOEUAkd45l20Us-__57h9MAmQm6gZhNzteqt4FFTwmaRLXwUp8Q Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:27:15.643610 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/277f81ef9ed74a6189221440edd53d4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 277f81ef9ed74a6189221440edd53d4c Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662044302 Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 31e94cc1c6a743ce898424ad7ba26cf1 Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662044302-project Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.645394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '029b110f-b393-4f26-a564-bc4c10ce744b'} Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:15.646318 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. Jun 17 07:27:15.647799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:27:15.649181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] Returning 404 to user: Instance 029b110f-b393-4f26-a564-bc4c10ce744b could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:15.649181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-84ebf3c0-1180-405a-88e2-a0b36c2a7c4f tempest-AttachVolumeShelveTestJSON-1662044302 tempest-AttachVolumeShelveTestJSON-1662044302-project] 10.222.0.33 "GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b" status: 404 len: 111 microversion: 2.20 time: 0.030970 Jun 17 07:27:15.649181 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 461/938] 10.222.0.33 () {60 vars in 1276 bytes} [Fri Jun 17 07:27:15 2022] GET /compute/v2.1/servers/029b110f-b393-4f26-a564-bc4c10ce744b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:21.777143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-880801ca-5807-4670-8b85-77ea7350d33f tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d39dc10>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:21.827812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-880801ca-5807-4670-8b85-77ea7350d33f tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/65da5f66-d3ef-4b30-9f15-234b9ca48a49" status: 200 len: 351 microversion: 2.1 time: 0.054706 Jun 17 07:27:21.828423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 478/939] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:27:21 2022] GET /compute/v2.1/os-volumes/65da5f66-d3ef-4b30-9f15-234b9ca48a49 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:27:23.176651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-17df6148-bc48-4aa1-8a89-e8fcf3948407 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d54f700>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:23.230290 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-17df6148-bc48-4aa1-8a89-e8fcf3948407 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9ef9a1a-e1f5-4fd4-845c-81fce0bdb3c1" status: 200 len: 350 microversion: 2.1 time: 0.057827 Jun 17 07:27:23.230862 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 462/940] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:27:23 2022] GET /compute/v2.1/os-volumes/f9ef9a1a-e1f5-4fd4-845c-81fce0bdb3c1 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:24.598344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-19744f04-7217-4301-b84b-6710ea3a5cc8 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d44db80>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:24.645398 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-19744f04-7217-4301-b84b-6710ea3a5cc8 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/347d0fdf-de0a-429f-b3fa-0d566f7c08b6" status: 200 len: 351 microversion: 2.1 time: 0.051711 Jun 17 07:27:24.645965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 479/941] 10.222.0.33 () {58 vars in 1244 bytes} [Fri Jun 17 07:27:24 2022] GET /compute/v2.1/os-volumes/347d0fdf-de0a-429f-b3fa-0d566f7c08b6 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:24.658161 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a0a1c9d3-a1c9-45e5-aa68-aab7484a1066 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d57b790>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:24.741398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a0a1c9d3-a1c9-45e5-aa68-aab7484a1066 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087551 Jun 17 07:27:24.741973 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 463/942] 10.222.0.33 () {58 vars in 1133 bytes} [Fri Jun 17 07:27:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:24.755561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-29340a9c-6bd7-4b61-b2b9-42c4e7919d60 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d704e50>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:24.836917 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-29340a9c-6bd7-4b61-b2b9-42c4e7919d60 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086936 Jun 17 07:27:24.837491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 480/943] 10.222.0.33 () {58 vars in 1148 bytes} [Fri Jun 17 07:27:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:24.850153 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3216ebe9-ba68-4be7-ad1c-b0c32542bd26 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d5e0790>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:24.933398 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3216ebe9-ba68-4be7-ad1c-b0c32542bd26 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087029 Jun 17 07:27:24.933965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 464/944] 10.222.0.33 () {58 vars in 1133 bytes} [Fri Jun 17 07:27:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:24.945645 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-1d52e7a6-cfb8-4f8f-9412-35072da18b27 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d4568b0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.026111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-1d52e7a6-cfb8-4f8f-9412-35072da18b27 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084159 Jun 17 07:27:25.026675 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 481/945] 10.222.0.33 () {58 vars in 1166 bytes} [Fri Jun 17 07:27:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:25.038618 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-275d1abb-af84-42ed-9dc3-94cb88d81591 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d607790>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.122220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-275d1abb-af84-42ed-9dc3-94cb88d81591 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087327 Jun 17 07:27:25.122825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 465/946] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Jun 17 07:27:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:25.142351 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9d65629a-3012-4d51-98be-0e5e89811232 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d35a280>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.223324 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9d65629a-3012-4d51-98be-0e5e89811232 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084713 Jun 17 07:27:25.223884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 482/947] 10.222.0.33 () {58 vars in 1154 bytes} [Fri Jun 17 07:27:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:25.235461 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0cf92d38-eb2c-4052-a1ab-d8267d93c57a tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d57b3a0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.316147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0cf92d38-eb2c-4052-a1ab-d8267d93c57a tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084947 Jun 17 07:27:25.316727 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 466/948] 10.222.0.33 () {58 vars in 1187 bytes} [Fri Jun 17 07:27:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:25.328676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6fae30c8-7a4c-4864-9da4-2612324d2cd6 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] Calling method '.version_select at 0x7f8b6d35adc0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:25.429569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6fae30c8-7a4c-4864-9da4-2612324d2cd6 tempest-VolumesTestJSON-949022427 tempest-VolumesTestJSON-949022427-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105139 Jun 17 07:27:25.430137 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 483/949] 10.222.0.33 () {58 vars in 1154 bytes} [Fri Jun 17 07:27:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:32.617263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:32.618274 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:32.623973 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:32.624525 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:32.635232 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.635685 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.636524 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.637107 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.662865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-58ba1c0d-5ff8-4123-90db-a2b587a3a009 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/ips" status: 200 len: 149 microversion: 2.1 time: 0.046459 Jun 17 07:27:32.663442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 467/950] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:27:32 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:32.670734 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=12 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:32.672539 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=24 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:32.677604 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b55e59f-23b2-446c-aa93-0eac359657a8"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:32.678651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:32.693231 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.693886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.694830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.695310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.802591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: POST /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/os-volume_attachments HTTP/1.1 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 74 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:32.804243 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {"volumeAttachment": {"volumeId": "2b55e59f-23b2-446c-aa93-0eac359657a8"}} Jun 17 07:27:32.805951 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'server_id': 'c0db5765-c86f-4fac-9e92-ac1ff1147709', 'body': {'volumeAttachment': {'volumeId': '2b55e59f-23b2-446c-aa93-0eac359657a8'}}} Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:32.806884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:32.809492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 400 to user: Invalid volume: volume 2b55e59f-23b2-446c-aa93-0eac359657a8 is already attached to instances: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0897000c-357f-4ba7-9916-d2e2d34b9ba3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135712 Jun 17 07:27:32.811899 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 484/951] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:27:32 2022] POST /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:27:32.829013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:32.830193 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:32.840013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.840616 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.841520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.842013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.871558 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:27:32.956410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1a51a965-728b-4e1b-badb-7c81337f7ce7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 204 len: 0 microversion: 2.1 time: 0.131100 Jun 17 07:27:32.957078 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 468/952] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:27:32 2022] DELETE /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:27:32.966150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:32.966777 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:32.976980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.978039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:32.978834 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:32.979684 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:33.382663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:33.390298 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c6b87b58-7e29-4f3a-85b2-a3aa85b43f34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1679 microversion: 2.1 time: 0.428385 Jun 17 07:27:33.390950 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 485/953] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:32 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1679 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:34.409121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:34.409909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:34.416684 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:34.417120 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:34.417870 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:34.418303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:34.547736 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:34.555679 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-830dc59c-cd3e-450e-928e-5dc566db6662 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1679 microversion: 2.1 time: 0.151408 Jun 17 07:27:34.556284 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 469/954] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:34 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:35.574930 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:35.575823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:35.584036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:35.584545 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:35.585481 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:35.586055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:35.721059 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:35.730888 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-973d7c9e-1e73-4634-a755-bb0756f892eb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1679 microversion: 2.1 time: 0.160686 Jun 17 07:27:35.732133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 486/955] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:35 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:36.748801 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:36.749403 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:36.756014 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:36.756493 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:36.757244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:36.757672 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:36.938459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:36.946803 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d928771c-0441-4256-98be-890904d0f1f4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1679 microversion: 2.1 time: 0.201474 Jun 17 07:27:36.951427 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 470/956] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:36 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:37.758998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-72c2e941-3f74-438d-9d25-d2e5e7e8138a req-830a037b-75d7-40c8-81a8-3832ab91c639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0db5765-c86f-4fac-9e92-ac1ff1147709", "name": "network-vif-deleted", "tag": "33826e23-a394-46bb-a05a-72936c98c2a5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:37.768732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-72c2e941-3f74-438d-9d25-d2e5e7e8138a req-830a037b-75d7-40c8-81a8-3832ab91c639 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:37.769089 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-72c2e941-3f74-438d-9d25-d2e5e7e8138a req-830a037b-75d7-40c8-81a8-3832ab91c639 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:37.780847 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-72c2e941-3f74-438d-9d25-d2e5e7e8138a req-830a037b-75d7-40c8-81a8-3832ab91c639 service nova] Creating event network-vif-deleted:33826e23-a394-46bb-a05a-72936c98c2a5 for instance c0db5765-c86f-4fac-9e92-ac1ff1147709 on hv-cinder-83482 Jun 17 07:27:37.785785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-72c2e941-3f74-438d-9d25-d2e5e7e8138a req-830a037b-75d7-40c8-81a8-3832ab91c639 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030354 Jun 17 07:27:37.786450 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 487/957] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:37.965554 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:37.966432 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:37.978040 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:37.978401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:37.979176 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:37.979608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:38.016286 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:38.016716 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:38.017160 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lazy-loading 'fault' on Instance uuid c0db5765-c86f-4fac-9e92-ac1ff1147709 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:27:38.065009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:38.072638 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f1f2e7ce-d88f-4964-9c2a-fbdeef0f750f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 200 len: 1330 microversion: 2.1 time: 0.112293 Jun 17 07:27:38.073548 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 471/958] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:37 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:39.092123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:39.092855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:39.099242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:39.099691 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:39.100542 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:39.100965 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:39.115515 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 HTTP/1.1 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:39.117196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:27:39.118940 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'c0db5765-c86f-4fac-9e92-ac1ff1147709'} Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:39.120002 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:27:39.121561 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:39.124232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:39.124232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-85ba779e-f79d-4d3f-a111-ec1e7eda8765 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 404 len: 111 microversion: 2.1 time: 0.031280 Jun 17 07:27:39.124232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 488/959] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:39 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:27:39.129387 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c1a6b2e0-fd27-4898-b0b1-8b8161568d7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '.version_select at 0x7f8b6d6ce5e0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:39.149986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c1a6b2e0-fd27-4898-b0b1-8b8161568d7e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455796605" status: 202 len: 0 microversion: 2.1 time: 0.025614 Jun 17 07:27:39.150613 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 472/960] 10.222.0.33 () {58 vars in 1217 bytes} [Fri Jun 17 07:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455796605 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:27:39.822979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:39.823476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:39.829577 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:39.830035 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:39.830795 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:39.831232 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:39.912890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lazy-loading 'services' on Instance uuid 4dfd3a40-1403-42b7-a67e-0c3ba06d253f {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:27:39.984773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-64f7ab48-d67b-4f17-bf73-c2e77e51a39d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments/2b55e59f-23b2-446c-aa93-0eac359657a8" status: 202 len: 0 microversion: 2.1 time: 0.165540 Jun 17 07:27:39.985371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 489/961] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:27:39 2022] DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments/2b55e59f-23b2-446c-aa93-0eac359657a8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:27:39.993985 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:39.994912 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:40.002123 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:40.002718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:40.003669 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:40.004169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:40.035263 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8a254c1f-6265-47cb-9c76-1b9202fedee5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Jun 17 07:27:40.036082 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 473/962] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:27:39 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:41.049334 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:41.050423 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:41.056769 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.057155 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.057909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.058337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.087209 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ae30e9ec-9612-44d6-ae44-ca78514245b0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044307 Jun 17 07:27:41.088019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 490/963] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:27:41 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:27:41.145481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:41.146028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:41.152371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.152826 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.153593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.154032 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.180502 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:27:41.256290 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2018c055-f435-4853-bf83-96b4a759c5da tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 204 len: 0 microversion: 2.1 time: 0.114207 Jun 17 07:27:41.257106 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 474/964] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:27:41 2022] DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:27:41.267136 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:41.267738 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:41.273771 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.274206 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.274955 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:41.275382 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:41.409883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:41.417645 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-30f5cb7e-7255-4d1f-8677-f7c381a8994f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1683 microversion: 2.1 time: 0.154581 Jun 17 07:27:41.418203 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 491/965] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:41 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:42.436058 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:42.436814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:42.443443 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:42.443887 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:42.444676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:42.445118 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:42.577391 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:42.585743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-730f41f7-e7c0-40aa-82fc-2bfa1e50cc62 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1683 microversion: 2.1 time: 0.154014 Jun 17 07:27:42.586324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 475/966] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:42 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:43.603263 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:43.603911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:43.610806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:43.611252 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:43.612021 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:43.612475 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:43.686099 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:43.695135 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-0047fbc7-f729-455d-bf0d-6b728e06b0b9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 200 len: 1615 microversion: 2.1 time: 0.095803 Jun 17 07:27:43.705534 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 492/967] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:43 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:43.838817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-e4d1f72a-668e-4f94-b7bd-35c98d26ba56 req-992f5b86-ab30-4ae0-bffe-f31521b05346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfd3a40-1403-42b7-a67e-0c3ba06d253f", "name": "network-vif-deleted", "tag": "d2ebaf58-5cce-403d-9c3e-f3aa34003d90"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:43.848740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-e4d1f72a-668e-4f94-b7bd-35c98d26ba56 req-992f5b86-ab30-4ae0-bffe-f31521b05346 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:43.849187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-e4d1f72a-668e-4f94-b7bd-35c98d26ba56 req-992f5b86-ab30-4ae0-bffe-f31521b05346 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:43.861955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-e4d1f72a-668e-4f94-b7bd-35c98d26ba56 req-992f5b86-ab30-4ae0-bffe-f31521b05346 service nova] Creating event network-vif-deleted:d2ebaf58-5cce-403d-9c3e-f3aa34003d90 for instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f on hv-cinder-83482 Jun 17 07:27:43.867409 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-e4d1f72a-668e-4f94-b7bd-35c98d26ba56 req-992f5b86-ab30-4ae0-bffe-f31521b05346 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032229 Jun 17 07:27:43.868015 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 476/968] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:44.713776 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:44.714166 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:44.720580 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:44.720959 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:44.721752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:44.722375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:44.738867 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f HTTP/1.1 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:27:44.740639 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:27:44.742268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '4dfd3a40-1403-42b7-a67e-0c3ba06d253f'} Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:27:44.743125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:27:44.744633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:27:44.746001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:27:44.746001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-39d74f26-e19d-40f2-908f-8934d8f33cc4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 404 len: 111 microversion: 2.1 time: 0.032865 Jun 17 07:27:44.746001 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 493/969] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:44 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:27:44.752898 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5d03cfaa-0b52-4fd1-ac2f-9d28cbab41df tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '.version_select at 0x7f8b6d437790>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:44.770438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5d03cfaa-0b52-4fd1-ac2f-9d28cbab41df tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-214491179" status: 202 len: 0 microversion: 2.1 time: 0.022821 Jun 17 07:27:44.771124 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 477/970] 10.222.0.33 () {58 vars in 1217 bytes} [Fri Jun 17 07:27:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-214491179 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:27:45.445234 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d33557ac-1906-4f78-bd4c-6912a096b2af tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: .version_select at 0x7f8b6d39d3a0>, body: {"keypair": {"name": "tempest-keypair-852386854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGweS3XLFLeeZeO9Y+aWm7LIzzz3lsQNsCAgwYnKqV6JremWEUPcsgf8TYkoYb5bD41ZkMYL1wKPalD+l2mhezYsoZr202i2sOsLxVNuBne+duOmVuCiF79rtxvzLccE0A=="}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:45.460380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-d33557ac-1906-4f78-bd4c-6912a096b2af tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:27:45.464378 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-d33557ac-1906-4f78-bd4c-6912a096b2af tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:27:45.486498 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d33557ac-1906-4f78-bd4c-6912a096b2af tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045438 Jun 17 07:27:45.487097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 494/971] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:27:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:46.808371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1892949114", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69bdf73b-b655-40e8-99ba-01f63a3ac44d"}], "security_groups": [{"name": "tempest-securitygroup--1482114440"}], "key_name": "tempest-keypair-852386854", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:46.917814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] validate_networks() for [('69bdf73b-b655-40e8-99ba-01f63a3ac44d', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:27:47.286143 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:27:47.286558 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:27:47.287026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:27:47.287429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:27:47.287830 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:27:47.296593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:47.297037 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:47.297823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:47.298251 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:47.320362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:27:47.324785 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:27:47.336865 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:27:47.339236 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:27:47.387900 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ee13fe0c-5a71-4007-a07f-d6927c8834c7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584028 Jun 17 07:27:47.394031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 478/972] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:27:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:27:47.399492 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8714fa5c-a5f4-42cb-b9a7-86669432ceb4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:47.400117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8714fa5c-a5f4-42cb-b9a7-86669432ceb4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:47.459879 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8714fa5c-a5f4-42cb-b9a7-86669432ceb4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:47.468117 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8714fa5c-a5f4-42cb-b9a7-86669432ceb4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1241 microversion: 2.1 time: 0.072529 Jun 17 07:27:47.468711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 495/973] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:47 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:48.486592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:48.487203 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:48.494718 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:48.495169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:48.495919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:48.496386 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:48.585543 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:48.597021 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1018c3bf-fc26-446a-8279-b55b84744ea4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1301 microversion: 2.1 time: 0.115058 Jun 17 07:27:48.598305 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 479/974] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:48 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:49.616482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:49.617167 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:49.626238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:49.626697 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:49.627486 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:49.627930 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:49.768122 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:49.775903 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-77798db4-0b62-4273-a70e-49dc87ff367f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.164163 Jun 17 07:27:49.781518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 496/975] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:49 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:50.197815 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-9f0a9d03-af5f-4969-92a1-6b76f0626496 req-f30da22c-32b2-49eb-809b-02635a4513cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6a9ab0-230d-4e55-9767-b821f0036ef3", "tag": "a134c0b8-33ae-413a-a0ae-5b188f660f0b"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:50.208812 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9f0a9d03-af5f-4969-92a1-6b76f0626496 req-f30da22c-32b2-49eb-809b-02635a4513cc service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:50.209112 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9f0a9d03-af5f-4969-92a1-6b76f0626496 req-f30da22c-32b2-49eb-809b-02635a4513cc service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:50.237532 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-9f0a9d03-af5f-4969-92a1-6b76f0626496 req-f30da22c-32b2-49eb-809b-02635a4513cc service nova] Creating event network-changed:a134c0b8-33ae-413a-a0ae-5b188f660f0b for instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 on hv-cinder-83482 Jun 17 07:27:50.250329 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-9f0a9d03-af5f-4969-92a1-6b76f0626496 req-f30da22c-32b2-49eb-809b-02635a4513cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060846 Jun 17 07:27:50.253052 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 480/976] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:50.793922 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:50.794528 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:50.801723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:50.802089 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:50.802857 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:50.803283 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:50.933306 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:50.940775 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8117ecbe-b8bf-45da-8c3e-8a85b1ebc42a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.150711 Jun 17 07:27:50.941365 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 497/977] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:50 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:51.959964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:51.960697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:51.967030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:51.967482 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:51.968288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:51.968731 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:52.109170 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:52.117793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-91160d30-840c-4994-a97f-34e8fbdcf47d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.162464 Jun 17 07:27:52.118380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 481/978] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:51 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:53.135096 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:53.135669 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:53.142296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:53.142746 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:53.143497 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:53.143924 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:53.281105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:53.289250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c435f76e-6f7e-4a82-a10d-0d250bf569d9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.158099 Jun 17 07:27:53.289813 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 498/979] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:53 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:54.310968 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:54.311670 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:54.321906 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:54.322356 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:54.323596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:54.324426 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:54.482364 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:54.490642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-31aeafa4-ab85-4096-86f0-5648393cce99 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.186272 Jun 17 07:27:54.491224 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 482/980] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:54 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:55.509312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:55.509923 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:55.517421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:55.517872 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:55.518634 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:55.519173 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:55.658433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:55.666673 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-433e6e5e-cb73-443b-857b-0e997dfd692c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.162387 Jun 17 07:27:55.667260 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 499/981] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:55 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:56.684321 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:56.684961 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:56.692479 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:56.692938 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:56.693730 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:56.694169 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:56.845076 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:56.852863 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7f2c3f3f-f77f-46dc-b70f-45356633e07b tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.172637 Jun 17 07:27:56.853432 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 483/982] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:56 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:27:57.832874 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-e210d883-04cc-431b-a94f-beb5ebdb2c3b req-85dfe991-4683-43b4-bd6f-40b4d4146ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6a9ab0-230d-4e55-9767-b821f0036ef3", "name": "network-vif-plugged", "status": "completed", "tag": "a134c0b8-33ae-413a-a0ae-5b188f660f0b"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:27:57.839461 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=6 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:57.850070 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e210d883-04cc-431b-a94f-beb5ebdb2c3b req-85dfe991-4683-43b4-bd6f-40b4d4146ab5 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:57.850645 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e210d883-04cc-431b-a94f-beb5ebdb2c3b req-85dfe991-4683-43b4-bd6f-40b4d4146ab5 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:57.863679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-e210d883-04cc-431b-a94f-beb5ebdb2c3b req-85dfe991-4683-43b4-bd6f-40b4d4146ab5 service nova] Creating event network-vif-plugged:a134c0b8-33ae-413a-a0ae-5b188f660f0b for instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 on hv-cinder-83482 Jun 17 07:27:57.870165 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-e210d883-04cc-431b-a94f-beb5ebdb2c3b req-85dfe991-4683-43b4-bd6f-40b4d4146ab5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041921 Jun 17 07:27:57.871044 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 500/983] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:27:57.871901 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:57.872696 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:57.875216 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:57.876888 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:57.886133 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:57.886579 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:57.887661 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:57.888402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:57.894303 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:27:58.086265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:58.095184 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5287bf5d-2517-49c3-bdd3-b9dc0ed492b5 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.228755 Jun 17 07:27:58.095880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 484/984] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:57 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:27:59.112447 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:27:59.113151 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:27:59.120000 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:59.120484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:59.121260 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:27:59.121701 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:27:59.265620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:27:59.275250 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-27223b50-939c-4cec-b398-48833bafc598 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1367 microversion: 2.1 time: 0.167016 Jun 17 07:27:59.275830 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 501/985] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:27:59 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:00.292470 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:00.293084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:00.300584 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:00.301034 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:00.301811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:00.302248 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:00.448558 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:00.456423 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aea46fd8-6dfb-4611-96f8-1025681d4eb3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1557 microversion: 2.1 time: 0.167724 Jun 17 07:28:00.457006 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 485/986] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:00 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:00.475118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:00.475709 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:00.482735 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:00.483185 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:00.483964 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:00.484429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:00.574053 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-850c2ddb-50cb-49ac-a194-72ae4bf1b524 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102820 Jun 17 07:28:00.574723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 502/987] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:28:00 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:01.590880 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-f0ec496c-ef12-48a5-80c9-fef3aec5c35c req-3305bcec-70b3-4cd5-8f67-972f674421d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6a9ab0-230d-4e55-9767-b821f0036ef3", "tag": "a134c0b8-33ae-413a-a0ae-5b188f660f0b"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:01.600801 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-f0ec496c-ef12-48a5-80c9-fef3aec5c35c req-3305bcec-70b3-4cd5-8f67-972f674421d1 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:01.601244 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-f0ec496c-ef12-48a5-80c9-fef3aec5c35c req-3305bcec-70b3-4cd5-8f67-972f674421d1 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:01.614039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-f0ec496c-ef12-48a5-80c9-fef3aec5c35c req-3305bcec-70b3-4cd5-8f67-972f674421d1 service nova] Creating event network-changed:a134c0b8-33ae-413a-a0ae-5b188f660f0b for instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 on hv-cinder-83482 Jun 17 07:28:01.619976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-f0ec496c-ef12-48a5-80c9-fef3aec5c35c req-3305bcec-70b3-4cd5-8f67-972f674421d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031964 Jun 17 07:28:01.619976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 486/988] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:12.122657 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:12.123836 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:12.137959 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-f70b4c77-24fd-4e25-a3cd-5c7ff3dc0fd9 req-11a12003-8e1b-4208-bd20-2114f828ab5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:12.139752 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:12.142582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:12.152957 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:12.155404 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=12 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:12.158877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-f70b4c77-24fd-4e25-a3cd-5c7ff3dc0fd9 req-11a12003-8e1b-4208-bd20-2114f828ab5a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:12.160585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:12.161415 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:12.162679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:12.163145 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-f70b4c77-24fd-4e25-a3cd-5c7ff3dc0fd9 req-11a12003-8e1b-4208-bd20-2114f828ab5a service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:12.163877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:12.196300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-f70b4c77-24fd-4e25-a3cd-5c7ff3dc0fd9 req-11a12003-8e1b-4208-bd20-2114f828ab5a service nova] Creating event network-changed:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:28:12.209080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-f70b4c77-24fd-4e25-a3cd-5c7ff3dc0fd9 req-11a12003-8e1b-4208-bd20-2114f828ab5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082402 Jun 17 07:28:12.209810 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 487/989] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:28:12.212705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:28:12.349945 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-765275cc-0971-4b72-aeda-4c14cab235b2 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 204 len: 0 microversion: 2.1 time: 0.229753 Jun 17 07:28:12.350941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 503/990] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:28:12 2022] DELETE /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:28:12.361573 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:12.363627 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:12.370958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:12.371779 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:12.373394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:12.374519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:12.576370 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:12.588950 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-61f2590c-8939-4fb7-b9a4-b30795a43c2d tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.233173 Jun 17 07:28:12.589557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 488/991] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:12 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:13.610929 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:13.611536 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:13.618093 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:13.618543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:13.619401 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:13.619841 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:13.769196 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:13.779193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-62b932de-a4b3-4280-9bc3-3b05957e448f tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1567 microversion: 2.1 time: 0.172619 Jun 17 07:28:13.779770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 504/992] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:13 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:14.441726 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-9166ff93-3d58-4bdd-aba9-603c34f7beb9 req-f441f9b1-86c6-455c-9318-ed8161579c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b5c89eb-5da9-4ad8-8576-55a011ab582d", "name": "network-vif-deleted", "tag": "8f6e6009-fcde-4778-b310-a5edbcb21692"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:14.452208 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9166ff93-3d58-4bdd-aba9-603c34f7beb9 req-f441f9b1-86c6-455c-9318-ed8161579c69 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:14.452656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-9166ff93-3d58-4bdd-aba9-603c34f7beb9 req-f441f9b1-86c6-455c-9318-ed8161579c69 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:14.466091 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-9166ff93-3d58-4bdd-aba9-603c34f7beb9 req-f441f9b1-86c6-455c-9318-ed8161579c69 service nova] Creating event network-vif-deleted:8f6e6009-fcde-4778-b310-a5edbcb21692 for instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d on hv-cinder-83482 Jun 17 07:28:14.471174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-9166ff93-3d58-4bdd-aba9-603c34f7beb9 req-f441f9b1-86c6-455c-9318-ed8161579c69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jun 17 07:28:14.471783 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 489/993] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:14.801886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:14.803336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:14.815312 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:14.817153 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:14.818399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:14.818898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:14.868380 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:14.868828 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:14.869289 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lazy-loading 'fault' on Instance uuid 6b5c89eb-5da9-4ad8-8576-55a011ab582d {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:28:14.931591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f2cda914b74f979746f4fb370eaae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92a857cef0a43d4907fbc667e30df6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:14.954765 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a600d128-721f-4d1e-aaac-2378b3f4a881 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 200 len: 1223 microversion: 2.1 time: 0.160623 Jun 17 07:28:14.956356 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 505/994] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:14 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 1223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:15.976922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:15.977655 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] [instance: 6b5c89eb-5da9-4ad8-8576-55a011ab582d] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:15.984339 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:15.984789 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:15.986150 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:15.986595 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:16.000615 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] HTTP exception thrown: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Request method failure captured: Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d HTTP/1.1 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCu2F2rcHpgsai1jvOBsBlEy00Ap3EXXVKUVICA1tb45Lb-YwUzy80B8vfesmNK7771UWBTP44OeDnzSKGBs3hECW2sM0YuTLsmFUGyQtmele2_QuEOqv9Ty8kcoQmHQZsb8Qtzni0hcAMxO3VsKYcaxb10YtvaMsFea32BRSVjN2t4 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: f92a857cef0a43d4907fbc667e30df6d Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-TestShelveInstance-1754131648 Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:28:16.002273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f92a857cef0a43d4907fbc667e30df6d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f92a857cef0a43d4907fbc667e30df6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f92a857cef0a43d4907fbc667e30df6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f92a857cef0a43d4907fbc667e30df6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-TestShelveInstance-1754131648 Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: f92a857cef0a43d4907fbc667e30df6d Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-TestShelveInstance-1754131648 Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-TestShelveInstance-1754131648-project Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 86f2cda914b74f979746f4fb370eaae6 Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-TestShelveInstance-1754131648-project Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. Jun 17 07:28:16.004081 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '6b5c89eb-5da9-4ad8-8576-55a011ab582d'} Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:28:16.005101 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. Jun 17 07:28:16.006682 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:16.008300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Returning 404 to user: Instance 6b5c89eb-5da9-4ad8-8576-55a011ab582d could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:28:16.008300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-620914b1-840e-403b-9e2c-402eebbfd679 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d" status: 404 len: 111 microversion: 2.1 time: 0.031709 Jun 17 07:28:16.008300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 490/995] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:15 2022] GET /compute/v2.1/servers/6b5c89eb-5da9-4ad8-8576-55a011ab582d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:28:16.180979 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e64708ea-f47d-4e11-a60c-77f403058f37 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] Calling method '.version_select at 0x7f8b6d7043a0>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:16.202210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e64708ea-f47d-4e11-a60c-77f403058f37 tempest-TestShelveInstance-1754131648 tempest-TestShelveInstance-1754131648-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-578391782" status: 202 len: 0 microversion: 2.1 time: 0.026269 Jun 17 07:28:16.202799 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 506/996] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Jun 17 07:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-578391782 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:28:37.602828 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:37.603775 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:37.606733 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=8 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:37.607390 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=12 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:37.614103 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:37.614651 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:37.615447 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:37.616058 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:37.642557 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a3213bed-942a-488a-8152-ea37cafb9d64 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/ips" status: 200 len: 149 microversion: 2.1 time: 0.044674 Jun 17 07:28:37.643177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 491/997] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:28:37 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:39.084699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:39.085551 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:28:39.090111 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "979bc022-bf61-421a-9661-aa4834aabbd6"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:39.091178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:39.100225 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:39.100750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:39.101569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:39.102142 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:39.403176 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2e3b9cf6-238d-4b60-9d4a-ce1bc5559c93 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319534 Jun 17 07:28:39.404285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 507/998] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:28:39 2022] POST /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:45.887177 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "979bc022-bf61-421a-9661-aa4834aabbd6"}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:45.888273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:45.895881 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:45.896371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:45.897158 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:45.897596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:45.979311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: POST /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments HTTP/1.1 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 74 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:28:45.980970 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {"volumeAttachment": {"volumeId": "979bc022-bf61-421a-9661-aa4834aabbd6"}} Jun 17 07:28:45.982695 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'server_id': '8e6a9ab0-230d-4e55-9767-b821f0036ef3', 'body': {'volumeAttachment': {'volumeId': '979bc022-bf61-421a-9661-aa4834aabbd6'}}} Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:45.983850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:45.985956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 400 to user: Invalid volume: volume 979bc022-bf61-421a-9661-aa4834aabbd6 is already attached to instances: 8e6a9ab0-230d-4e55-9767-b821f0036ef3 {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ae90a86a-2388-4382-aed8-db8ff67c1f98 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099457 Jun 17 07:28:45.987590 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 492/999] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:28:45 2022] POST /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 07:28:46.043913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:46.044513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:46.051582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:46.052033 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:46.052835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:46.053276 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:46.135897 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lazy-loading 'services' on Instance uuid 8e6a9ab0-230d-4e55-9767-b821f0036ef3 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:28:46.208591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-06a6ed82-eed4-4b7c-b4c0-2ef3775b70b3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments/979bc022-bf61-421a-9661-aa4834aabbd6" status: 202 len: 0 microversion: 2.1 time: 0.169263 Jun 17 07:28:46.209479 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 508/1000] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:28:46 2022] DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments/979bc022-bf61-421a-9661-aa4834aabbd6 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:28:46.217674 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:46.218630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:46.226076 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:46.226539 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:46.227965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:46.227965 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:46.260162 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-fe9163c3-abf8-412d-be71-dec5106f3116 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Jun 17 07:28:46.260724 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 493/1001] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:28:46 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:47.271576 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.272664 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:47.279672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.280140 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.280911 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.281341 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.314717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-03eb9ed8-bd1b-4300-a5ef-f9d4ed5ab5e7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047372 Jun 17 07:28:47.315316 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 509/1002] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:28:47.381401 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.382052 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:47.388922 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.389712 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.390156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.390604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.418312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:28:47.509544 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ec7f9987-5bf5-4843-ae75-884d97501ccb tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 204 len: 0 microversion: 2.1 time: 0.131658 Jun 17 07:28:47.510929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 494/1003] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:28:47 2022] DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:28:47.519158 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:47.519773 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:47.529625 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.530202 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.531132 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:47.531694 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:47.671019 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:47.679036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-afa26e26-fbd8-4e9f-bd56-706a1a21e99f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1681 microversion: 2.1 time: 0.164412 Jun 17 07:28:47.679604 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 510/1004] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:47 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:48.697183 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:48.697894 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:48.704823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:48.705293 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:48.706055 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:48.706496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:48.847026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:48.856634 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-3f422c8b-b969-4fdc-ba91-f169436f8e15 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1681 microversion: 2.1 time: 0.163629 Jun 17 07:28:48.857239 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 495/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:48 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:49.863065 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-04824713-4f62-4fc9-940c-3bb6b298dfeb req-ca8177e8-99e3-460d-828c-67c38a3e9a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6a9ab0-230d-4e55-9767-b821f0036ef3", "name": "network-vif-deleted", "tag": "a134c0b8-33ae-413a-a0ae-5b188f660f0b"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:49.873851 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-04824713-4f62-4fc9-940c-3bb6b298dfeb req-ca8177e8-99e3-460d-828c-67c38a3e9a4e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:49.874301 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-04824713-4f62-4fc9-940c-3bb6b298dfeb req-ca8177e8-99e3-460d-828c-67c38a3e9a4e service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:49.880910 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:49.881523 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:49.886795 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-04824713-4f62-4fc9-940c-3bb6b298dfeb req-ca8177e8-99e3-460d-828c-67c38a3e9a4e service nova] Creating event network-vif-deleted:a134c0b8-33ae-413a-a0ae-5b188f660f0b for instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 on hv-cinder-83482 Jun 17 07:28:49.891880 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-04824713-4f62-4fc9-940c-3bb6b298dfeb req-ca8177e8-99e3-460d-828c-67c38a3e9a4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033193 Jun 17 07:28:49.892753 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 511/1006] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:49.914592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:49.915362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:49.916442 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:49.917051 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:50.009882 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:50.019520 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e75985ed-76ad-448b-b492-5d97135dccec tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 200 len: 1326 microversion: 2.1 time: 0.148458 Jun 17 07:28:50.020122 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 496/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:49 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:28:51.040883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:51.042178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:51.052678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.053364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:51.054320 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.054930 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:51.073281 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 HTTP/1.1 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:28:51.074958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:28:51.078129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '8e6a9ab0-230d-4e55-9767-b821f0036ef3'} Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:28:51.081336 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:28:51.086679 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:51.090556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:28:51.090556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ced8eb08-b1e0-4fd3-ab54-fd8379310c02 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 404 len: 111 microversion: 2.1 time: 0.041419 Jun 17 07:28:51.090556 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 512/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:51 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:28:51.091443 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f4d1670d-8a56-4e12-8090-8d313fdce041 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '.version_select at 0x7f8b6d656ee0>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:51.113033 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f4d1670d-8a56-4e12-8090-8d313fdce041 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852386854" status: 202 len: 0 microversion: 2.1 time: 0.030538 Jun 17 07:28:51.114186 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 497/1009] 10.222.0.33 () {58 vars in 1217 bytes} [Fri Jun 17 07:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852386854 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:28:51.714741 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:51.715345 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:51.721996 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.722520 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:51.723409 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.723832 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:51.752302 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:28:51.773635 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-13230993-6bad-4a15-86b8-d2589f9dae2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: .version_select at 0x7f8b6d78ba60>, body: {"keypair": {"name": "tempest-keypair-274471504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCqss4XYKsDx5ozHp2Wp/eqQVX6smp3hBf5I93Z9vT73hXeNOeCUpm8L6nxF4Pl8OL5bo07rIpEClg64fKLNaVmquPf7jMyLNQJcnfh3tGmzA2/SlETANPWc5B5PEfMRg=="}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:51.789047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-13230993-6bad-4a15-86b8-d2589f9dae2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:28:51.793869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-13230993-6bad-4a15-86b8-d2589f9dae2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'key_pairs'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:28:51.820013 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-13230993-6bad-4a15-86b8-d2589f9dae2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054212 Jun 17 07:28:51.820790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 498/1010] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Jun 17 07:28:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:28:51.841814 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b62966ee-dfe8-48ba-ab4a-222f1ff1318e tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 204 len: 0 microversion: 2.1 time: 0.131358 Jun 17 07:28:51.842397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 513/1011] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:28:51 2022] DELETE /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 07:28:51.850870 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:51.851743 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:51.859234 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.859438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:51.860115 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:51.860796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:52.019232 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:52.026986 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ca1c7efb-bded-46d7-90a1-76d5716c3384 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1576 microversion: 2.1 time: 0.180120 Jun 17 07:28:52.028161 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 499/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:51 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:53.045869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:53.046591 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:53.055644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:53.056137 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:53.056927 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:53.057574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:53.188926 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-923239612", "imageRef": "8680be05-a911-41f8-a99b-6296e431fa5e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69bdf73b-b655-40e8-99ba-01f63a3ac44d"}], "security_groups": [{"name": "tempest-securitygroup--1795461171"}], "key_name": "tempest-keypair-274471504", "user_data": "}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:53.206229 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:53.214438 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3e436307-1ca9-4ae4-84b0-731de1260b95 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1576 microversion: 2.1 time: 0.173074 Jun 17 07:28:53.215012 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 514/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:53 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:53.307571 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] validate_networks() for [('69bdf73b-b655-40e8-99ba-01f63a3ac44d', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:28:54.042156 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:28:54.042577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:28:54.043047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:28:54.043622 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:28:54.044114 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:28:54.055799 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:54.056350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:54.057459 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:54.057892 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:54.075614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:28:54.096136 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Getting quotas for user de859eecbef7498289f132a047e6e5f8 and project 9a7262e606264aba8be1c0008e93c0d2. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:28:54.115851 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:28:54.120190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8680be05-a911-41f8-a99b-6296e431fa5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:28:54.179931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-e1b0bfcc-8a65-42e4-8411-391d3246ca6d tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.995231 Jun 17 07:28:54.185369 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 500/1014] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:28:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:28:54.191227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2bd3b2b1-0926-455d-bc3e-641aeb3e5f2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:54.191849 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2bd3b2b1-0926-455d-bc3e-641aeb3e5f2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:54.235886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:54.237563 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:54.249507 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:54.250642 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:54.252246 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:54.253204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:54.272890 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2bd3b2b1-0926-455d-bc3e-641aeb3e5f2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:54.284998 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2bd3b2b1-0926-455d-bc3e-641aeb3e5f2e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1240 microversion: 2.1 time: 0.098049 Jun 17 07:28:54.296806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 515/1015] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:54 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:54.362773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:54.382137 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ffe2f57f-b06f-4a6e-a7c0-5e6bf743ede2 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1508 microversion: 2.1 time: 0.150999 Jun 17 07:28:54.395067 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 501/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:54 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:54.889388 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-5b9a0c1f-bbf3-4e8e-8bad-0741d813aa82 req-dd44e963-cb70-47b9-9260-4227c62bb5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47fec78-0275-4db6-a345-a4999f2863b4", "name": "network-vif-deleted", "tag": "f987d351-5531-4e29-9020-013999acc4e6"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:54.901054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-5b9a0c1f-bbf3-4e8e-8bad-0741d813aa82 req-dd44e963-cb70-47b9-9260-4227c62bb5ef service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:54.901655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-5b9a0c1f-bbf3-4e8e-8bad-0741d813aa82 req-dd44e963-cb70-47b9-9260-4227c62bb5ef service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:54.915941 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-5b9a0c1f-bbf3-4e8e-8bad-0741d813aa82 req-dd44e963-cb70-47b9-9260-4227c62bb5ef service nova] Creating event network-vif-deleted:f987d351-5531-4e29-9020-013999acc4e6 for instance d47fec78-0275-4db6-a345-a4999f2863b4 on hv-cinder-83482 Jun 17 07:28:54.921452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-5b9a0c1f-bbf3-4e8e-8bad-0741d813aa82 req-dd44e963-cb70-47b9-9260-4227c62bb5ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036270 Jun 17 07:28:54.922421 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 516/1017] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:55.312017 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:55.315034 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:55.329380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:55.329380 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:55.330059 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:55.330862 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:55.407046 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:55.409094 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:55.423659 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:55.424240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:55.425238 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:55.426058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:55.465683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:55.466453 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:55.467159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.objects.instance [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lazy-loading 'fault' on Instance uuid d47fec78-0275-4db6-a345-a4999f2863b4 {{(pid=117396) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:28:55.470555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:55.482437 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6b7f5ce3-0fa5-4eda-9570-33047001774c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1300 microversion: 2.1 time: 0.183495 Jun 17 07:28:55.483028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 502/1018] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:55 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:55.662145 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:55.671167 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cb4090e4-749a-4461-bd18-381257a29424 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 200 len: 1231 microversion: 2.1 time: 0.271959 Jun 17 07:28:55.681644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 517/1019] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:55 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 1231 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:56.498934 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:56.500384 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:56.508606 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:56.509465 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:56.510569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:56.511273 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:56.690169 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:56.690793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:56.699624 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:56.700379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:56.701159 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:56.701618 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:56.716262 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] HTTP exception thrown: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Request method failure captured: Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 HTTP/1.1 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCx1zvfe-8SXuEJ0lRTy-Wg7jL5NYFa95QJUTSH5Q1cJMSmQRA502ofsFTEA62zkUMiwFvCHKuY0Q_TyzL8n5-jAuzCVmrK6J67j6dkF4tUAOsI4PtUCMGK8BH--1OWHozuXgZpkHm3e4IU4dlAm7dLLiYd5uGW_-y7BsTY4Q24pRLM Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:28:56.719147 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2b7ae6a418640629020f39ac455d075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6a113fe9b988458d8e8898c5c9a8d02d Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:28:56.720782 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'd47fec78-0275-4db6-a345-a4999f2863b4'} Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:28:56.730909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:28:56.732288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:28:56.736222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Returning 404 to user: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:28:56.736222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b907b549-1065-4b56-9a16-3126627d4018 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 404 len: 111 microversion: 2.1 time: 0.035390 Jun 17 07:28:56.736222 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 518/1020] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:56 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:28:56.781671 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:56.796822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bf176ad7-779c-4ed4-bdf0-dc8e52cc71a0 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.298101 Jun 17 07:28:56.800285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 503/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:56 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:56.859403 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-297847977", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1704693656", "security_groups": [{"name": "tempest-secgroup-smoke-1395766797"}], "block_device_mapping_v2": [{"uuid": "8d26c78d-eaba-4e7b-a776-03068ad47f6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "270f7e8d-fe10-476d-b957-559a5be577a9"}]}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:56.981393 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.network.neutron [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] validate_networks() for [('270f7e8d-fe10-476d-b957-559a5be577a9', None, None, None, None, None)] {{(pid=117396) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:28:57.423914 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:28:57.424429 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image limits 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:28:57.424976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:28:57.425379 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image pref 0:0:0 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:28:57.425708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.virt.hardware [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117396) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:28:57.440241 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:57.440699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:57.441589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:57.441954 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:57.459963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:28:57.464115 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.quota [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for user 6a113fe9b988458d8e8898c5c9a8d02d and project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117396) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:28:57.497189 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-886a6670-568a-40c4-af4f-9ef3e725b5f6 req-fdc6d351-4832-4a4f-a58f-0030d32b4033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa2b704-ec2f-48b8-b240-b8402aecb597", "tag": "91c3214b-4e0f-426a-a447-c590713c9cb5"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:28:57.525702 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-886a6670-568a-40c4-af4f-9ef3e725b5f6 req-fdc6d351-4832-4a4f-a58f-0030d32b4033 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:57.526406 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-886a6670-568a-40c4-af4f-9ef3e725b5f6 req-fdc6d351-4832-4a4f-a58f-0030d32b4033 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:57.566848 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-886a6670-568a-40c4-af4f-9ef3e725b5f6 req-fdc6d351-4832-4a4f-a58f-0030d32b4033 service nova] Creating event network-changed:91c3214b-4e0f-426a-a447-c590713c9cb5 for instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 on hv-cinder-83482 Jun 17 07:28:57.567842 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Going to run 1 instances... {{(pid=117396) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:28:57.570855 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d26c78d-eaba-4e7b-a776-03068ad47f6a',volume_size=None,volume_type=None)] {{(pid=117396) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:28:57.572308 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-886a6670-568a-40c4-af4f-9ef3e725b5f6 req-fdc6d351-4832-4a4f-a58f-0030d32b4033 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078744 Jun 17 07:28:57.573196 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 504/1022] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:28:57.739275 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-03f30bc1-5f5d-4516-afc7-f846574a7876 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883682 Jun 17 07:28:57.741164 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 519/1023] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:28:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:28:57.751941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1083220f-14ca-47a6-9fc2-eb053e0954de tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:57.752720 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1083220f-14ca-47a6-9fc2-eb053e0954de tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:57.818095 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:57.819049 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:57.826399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:57.826934 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:57.827785 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:57.828362 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:57.885242 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1083220f-14ca-47a6-9fc2-eb053e0954de tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:57.892144 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1083220f-14ca-47a6-9fc2-eb053e0954de tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1094 microversion: 2.1 time: 0.145050 Jun 17 07:28:57.893285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 505/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:57 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1094 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:58.001518 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:58.014335 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6bdab245-64dd-4a8a-8be9-2980820a01e4 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.200187 Jun 17 07:28:58.014993 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 520/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:57 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:28:58.914091 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:58.914714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:58.931425 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:58.931884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:58.936394 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:58.936867 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:59.023220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:59.031624 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-43b995ef-1f0f-4c77-a3f9-3269bde9e004 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1136 microversion: 2.1 time: 0.124924 Jun 17 07:28:59.032759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:28:59.033235 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 506/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:58 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1136 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:28:59.033524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:28:59.042652 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:59.043102 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:59.043869 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:28:59.044329 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:28:59.204672 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:28:59.212129 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8bca66af-68bc-42f2-8474-914c75d98b6a tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.184670 Jun 17 07:28:59.212703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 521/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:28:59 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:00.052285 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:00.054385 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:00.064001 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:00.064745 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:00.065741 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:00.066577 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:00.150221 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:00.158744 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-5c22831e-0d9f-43d7-8628-147cfdf7c9ff tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1198 microversion: 2.1 time: 0.113301 Jun 17 07:29:00.159514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 507/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:00 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:00.229399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:00.230291 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:00.238025 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:00.238486 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:00.239269 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:00.239708 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:00.423786 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:00.434589 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-fecbaf41-9caa-4a70-bee8-18f7f1277ca9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.209342 Jun 17 07:29:00.436034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 522/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:00 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:01.087495 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-04fd8901-25dc-4424-b355-991bcef9813b req-3da2181d-0182-403e-86d7-950c628436ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bc2731-0299-4074-a682-9fd077b33e0b", "tag": "5f52cae1-9810-4adf-a88b-c23408fefe11"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:01.107509 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-04fd8901-25dc-4424-b355-991bcef9813b req-3da2181d-0182-403e-86d7-950c628436ee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:01.107964 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-04fd8901-25dc-4424-b355-991bcef9813b req-3da2181d-0182-403e-86d7-950c628436ee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:01.133711 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-04fd8901-25dc-4424-b355-991bcef9813b req-3da2181d-0182-403e-86d7-950c628436ee service nova] Creating event network-changed:5f52cae1-9810-4adf-a88b-c23408fefe11 for instance 45bc2731-0299-4074-a682-9fd077b33e0b on hv-cinder-83482 Jun 17 07:29:01.141034 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-04fd8901-25dc-4424-b355-991bcef9813b req-3da2181d-0182-403e-86d7-950c628436ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060512 Jun 17 07:29:01.141825 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 508/1030] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:01.180658 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:01.182722 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:01.193532 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:01.194209 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:01.195501 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:01.196086 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:01.394118 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:01.400862 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:01.408190 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-ef79aad9-e9cf-4100-b10b-dd788dd2196c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.234375 Jun 17 07:29:01.409255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 523/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:01 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:01.457511 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:01.458632 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:01.467833 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:01.468576 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:01.469760 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:01.470417 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:01.697099 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:01.706467 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d0809158-cf1d-4f65-93b2-24a8a469d062 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.256766 Jun 17 07:29:01.707616 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 509/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:01 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:02.098816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-e6a4b61e-2253-4c2d-bdc6-74e1c778cf6e req-5ad79229-8ccd-4e95-a314-cfbb453c5758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa2b704-ec2f-48b8-b240-b8402aecb597", "name": "network-vif-plugged", "status": "completed", "tag": "91c3214b-4e0f-426a-a447-c590713c9cb5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:02.113967 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e6a4b61e-2253-4c2d-bdc6-74e1c778cf6e req-5ad79229-8ccd-4e95-a314-cfbb453c5758 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:02.114913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e6a4b61e-2253-4c2d-bdc6-74e1c778cf6e req-5ad79229-8ccd-4e95-a314-cfbb453c5758 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:02.135938 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-e6a4b61e-2253-4c2d-bdc6-74e1c778cf6e req-5ad79229-8ccd-4e95-a314-cfbb453c5758 service nova] Creating event network-vif-plugged:91c3214b-4e0f-426a-a447-c590713c9cb5 for instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 on hv-cinder-83482 Jun 17 07:29:02.144953 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-e6a4b61e-2253-4c2d-bdc6-74e1c778cf6e req-5ad79229-8ccd-4e95-a314-cfbb453c5758 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053612 Jun 17 07:29:02.146903 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 524/1033] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:02.427909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:02.428739 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:02.436126 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:02.436654 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:02.437454 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:02.437927 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:02.726884 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:02.727599 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:02.734629 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:02.735887 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:02.736801 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:02.737233 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:02.899208 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:02.911620 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bb140379-b619-4ac6-a2f5-b885846e0c86 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.190257 Jun 17 07:29:02.912361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 525/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:02 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:02.951569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:02.959422 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-29e3e80f-5fe3-46b0-b75a-fa8b4c07b054 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.536151 Jun 17 07:29:02.959992 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 510/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:02 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:03.930571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:03.931230 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:03.939054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:03.939510 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:03.940323 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:03.940764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:03.978835 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:03.980950 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:04.016895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:04.017633 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:04.018443 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:04.018919 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:04.025151 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:04.067449 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:04.142674 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:04.153569 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-957874b3-7a01-4faa-9729-352239192b0e tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1366 microversion: 2.1 time: 0.227020 Jun 17 07:29:04.154390 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 526/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:03 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:04.204813 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:04.214604 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-23c6be74-35dd-4c52-aa35-7f961e9c6d50 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.240896 Jun 17 07:29:04.215162 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 511/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:03 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:05.171587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:05.173434 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:05.181282 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.181863 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.182835 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.183462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.237009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:05.237680 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:05.252272 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.252877 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.253856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.254560 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.353833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:05.365127 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-2f33370e-7324-445d-ad1c-ee6a6848c19f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1557 microversion: 2.1 time: 0.197591 Jun 17 07:29:05.383207 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 527/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:05 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:05.391062 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:05.392676 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:05.404943 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.405399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.406193 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:05.406635 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:05.470028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:05.479856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1e45a732-16e5-4f6f-9769-559eec1b3b22 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.247121 Jun 17 07:29:05.479856 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 512/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:05 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:29:05.503268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a5b9c249-d989-4e68-a337-8c13e7dfbd67 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118157 Jun 17 07:29:05.504200 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 528/1040] 10.222.0.33 () {58 vars in 1274 bytes} [Fri Jun 17 07:29:05 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:06.496976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:06.497580 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:06.512209 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:06.512519 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:06.513516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:06.513951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:06.564919 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-e80b1092-c97a-4ad7-a5cb-62ea15b4a407 req-4be3cb1c-7cc1-4593-8b9b-b14b7f74a851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa2b704-ec2f-48b8-b240-b8402aecb597", "tag": "91c3214b-4e0f-426a-a447-c590713c9cb5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:06.576638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e80b1092-c97a-4ad7-a5cb-62ea15b4a407 req-4be3cb1c-7cc1-4593-8b9b-b14b7f74a851 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:06.577633 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-e80b1092-c97a-4ad7-a5cb-62ea15b4a407 req-4be3cb1c-7cc1-4593-8b9b-b14b7f74a851 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:06.591702 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-e80b1092-c97a-4ad7-a5cb-62ea15b4a407 req-4be3cb1c-7cc1-4593-8b9b-b14b7f74a851 service nova] Creating event network-changed:91c3214b-4e0f-426a-a447-c590713c9cb5 for instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 on hv-cinder-83482 Jun 17 07:29:06.598515 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-e80b1092-c97a-4ad7-a5cb-62ea15b4a407 req-4be3cb1c-7cc1-4593-8b9b-b14b7f74a851 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037782 Jun 17 07:29:06.600041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 529/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:06.668445 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:06.676802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1397b541-0667-43f9-9017-50fa88960c97 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.183508 Jun 17 07:29:06.677937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 513/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:06 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:07.692177 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:07.693387 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=8 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:07.698944 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:07.699678 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:07.707432 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:07.707891 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:07.708725 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:07.709165 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:07.878766 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:07.887192 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-7c5b8dc6-8ba1-4558-8df7-b07f68765390 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.195945 Jun 17 07:29:07.887764 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 530/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:07 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:08.906252 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:08.908174 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:08.913481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=12 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:08.914402 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:08.924602 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:08.925064 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:08.926097 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:08.926630 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:09.196776 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:09.207866 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-183a990e-883a-43e5-9d1e-636c900e7be6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.305625 Jun 17 07:29:09.208508 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 514/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:08 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:10.227271 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:10.228675 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:10.230717 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:10.238011 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:10.238651 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:10.240228 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:10.241449 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:10.431913 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:10.440816 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-d673a10f-4f13-4054-9c56-394dffdaf1fb tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.217835 Jun 17 07:29:10.441479 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 531/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:10 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:11.458836 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:11.459636 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:11.466065 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:11.466518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:11.467517 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:11.468211 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:11.636474 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:11.644782 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-08433e06-6f38-4b5b-9ed3-98d479acc12a tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.190301 Jun 17 07:29:11.645364 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 515/1046] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:11 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:12.107104 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-9b9ac173-358d-4f17-81d0-da3b7143c21c req-1e4d071d-cfca-47dd-bf3e-c83abfb69034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bc2731-0299-4074-a682-9fd077b33e0b", "name": "network-vif-plugged", "status": "completed", "tag": "5f52cae1-9810-4adf-a88b-c23408fefe11"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:12.116795 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9b9ac173-358d-4f17-81d0-da3b7143c21c req-1e4d071d-cfca-47dd-bf3e-c83abfb69034 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:12.117300 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-9b9ac173-358d-4f17-81d0-da3b7143c21c req-1e4d071d-cfca-47dd-bf3e-c83abfb69034 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:12.131594 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-9b9ac173-358d-4f17-81d0-da3b7143c21c req-1e4d071d-cfca-47dd-bf3e-c83abfb69034 service nova] Creating event network-vif-plugged:5f52cae1-9810-4adf-a88b-c23408fefe11 for instance 45bc2731-0299-4074-a682-9fd077b33e0b on hv-cinder-83482 Jun 17 07:29:12.138663 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-9b9ac173-358d-4f17-81d0-da3b7143c21c req-1e4d071d-cfca-47dd-bf3e-c83abfb69034 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035521 Jun 17 07:29:12.139939 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 532/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:12.662811 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:12.664210 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:12.674609 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:12.674609 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:12.674609 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:12.674609 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:12.821483 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:12.829941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-c935e547-bd57-45e3-8a46-71a2a578d8a4 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1266 microversion: 2.1 time: 0.171193 Jun 17 07:29:12.830505 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 516/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:12 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:13.848420 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:13.849259 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:13.855476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:13.855942 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:13.859170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:13.859170 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:14.015137 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:14.027670 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-36f3c1a2-b89f-4ca9-b55a-72f75179b27f tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1453 microversion: 2.1 time: 0.184295 Jun 17 07:29:14.028292 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 533/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:13 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:14.046063 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:14.046790 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:14.058121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:14.058707 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:14.059611 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:14.060289 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:14.238773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:14.246562 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-99e911cb-900a-4b86-b01f-bdb5aacf68dc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1453 microversion: 2.1 time: 0.205133 Jun 17 07:29:14.247330 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 517/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:14 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:16.450887 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-1c5fea24-e5d1-4407-9d85-9d4cca96a504 req-8734e431-0844-45a2-a651-c16a1cbc3779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bc2731-0299-4074-a682-9fd077b33e0b", "tag": "5f52cae1-9810-4adf-a88b-c23408fefe11"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:16.462214 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1c5fea24-e5d1-4407-9d85-9d4cca96a504 req-8734e431-0844-45a2-a651-c16a1cbc3779 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:16.462638 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-1c5fea24-e5d1-4407-9d85-9d4cca96a504 req-8734e431-0844-45a2-a651-c16a1cbc3779 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:16.476646 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-1c5fea24-e5d1-4407-9d85-9d4cca96a504 req-8734e431-0844-45a2-a651-c16a1cbc3779 service nova] Creating event network-changed:5f52cae1-9810-4adf-a88b-c23408fefe11 for instance 45bc2731-0299-4074-a682-9fd077b33e0b on hv-cinder-83482 Jun 17 07:29:16.483150 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-1c5fea24-e5d1-4407-9d85-9d4cca96a504 req-8734e431-0844-45a2-a651-c16a1cbc3779 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035917 Jun 17 07:29:16.483977 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 534/1051] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:44.244350 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:44.244937 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:44.246740 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=7 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:44.247439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=40 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:44.253220 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:44.253706 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:44.254481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:44.254914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:44.278346 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4c60c672-a924-4118-a8e1-326a54157a34 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/ips" status: 200 len: 151 microversion: 2.1 time: 0.038102 Jun 17 07:29:44.278925 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 518/1052] 10.222.0.33 () {58 vars in 1247 bytes} [Fri Jun 17 07:29:44 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:45.618143 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=7 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:45.618883 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=48 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:29:45.623565 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a1846d-1e85-4e39-8071-9173bb1d0182"}} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:45.624760 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:45.632303 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:45.632755 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:45.633527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:45.633968 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:46.104258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-679b65c5-8dbe-4c56-8c60-82a5f4d65fe3 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "POST /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487387 Jun 17 07:29:46.105101 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 535/1053] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Jun 17 07:29:45 2022] POST /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:52.677868 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:52.678512 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:52.685362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:52.685806 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:52.686569 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:52.687001 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:52.833943 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lazy-loading 'services' on Instance uuid 3fa2b704-ec2f-48b8-b240-b8402aecb597 {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:29:52.932172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-654a2f29-0c3c-460f-9819-8322feb73105 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments/00a1846d-1e85-4e39-8071-9173bb1d0182" status: 202 len: 0 microversion: 2.1 time: 0.257912 Jun 17 07:29:52.932172 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 519/1054] 10.222.0.33 () {58 vars in 1415 bytes} [Fri Jun 17 07:29:52 2022] DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments/00a1846d-1e85-4e39-8071-9173bb1d0182 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:29:52.941462 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:52.942550 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:52.950557 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:52.951012 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:52.951796 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:52.952413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:52.986668 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e3be0124-e7cf-4dd2-bc7e-d0dd7c132b5f tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049587 Jun 17 07:29:52.986923 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 536/1055] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:29:52 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:53.999650 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:54.000754 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:54.007802 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.008306 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.009069 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.009514 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.042814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-aad9ab69-d95c-4be5-8870-2913f0504a22 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048003 Jun 17 07:29:54.043371 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 520/1056] 10.222.0.33 () {58 vars in 1301 bytes} [Fri Jun 17 07:29:53 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 07:29:54.105126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:54.105703 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:54.112958 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.113413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.114189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.114630 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.141408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Going to try to terminate instance {{(pid=117396) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:29:54.227309 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-cec80837-d1a4-4798-8c8c-1f789c1922e9 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 204 len: 0 microversion: 2.1 time: 0.126321 Jun 17 07:29:54.228495 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 537/1057] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:29:54 2022] DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:29:54.241219 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:54.242295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:54.251714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.252466 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.253829 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:54.254593 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:54.405599 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:54.414192 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-8ae778f5-4e39-4283-b512-16aa0f50ee85 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1682 microversion: 2.1 time: 0.180028 Jun 17 07:29:54.414769 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 521/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:54 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:55.432977 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:55.433680 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:55.440973 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:55.441484 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:55.442278 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:55.442704 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:55.592600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:55.601683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-6279f476-79d9-46f1-b90f-338f2c4ffd44 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1682 microversion: 2.1 time: 0.173234 Jun 17 07:29:55.602267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 538/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:55 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:56.620413 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:56.621029 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:56.628194 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:56.628814 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:56.629578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:56.630009 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:56.710891 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de859eecbef7498289f132a047e6e5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7262e606264aba8be1c0008e93c0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:29:56.717966 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-b7c31dc2-efe6-42de-87aa-8652244259c2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 200 len: 1614 microversion: 2.1 time: 0.102926 Jun 17 07:29:56.718528 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 522/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:56 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:29:56.781583 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-90deb80e-f9a6-48c3-9190-c8d619b399f8 req-343bb66d-9af5-44f7-971b-84a93ffd7900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa2b704-ec2f-48b8-b240-b8402aecb597", "name": "network-vif-deleted", "tag": "91c3214b-4e0f-426a-a447-c590713c9cb5"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:29:56.790508 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-90deb80e-f9a6-48c3-9190-c8d619b399f8 req-343bb66d-9af5-44f7-971b-84a93ffd7900 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:56.791083 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-90deb80e-f9a6-48c3-9190-c8d619b399f8 req-343bb66d-9af5-44f7-971b-84a93ffd7900 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:56.806587 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-90deb80e-f9a6-48c3-9190-c8d619b399f8 req-343bb66d-9af5-44f7-971b-84a93ffd7900 service nova] Creating event network-vif-deleted:91c3214b-4e0f-426a-a447-c590713c9cb5 for instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 on hv-cinder-83482 Jun 17 07:29:56.812505 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-90deb80e-f9a6-48c3-9190-c8d619b399f8 req-343bb66d-9af5-44f7-971b-84a93ffd7900 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Jun 17 07:29:56.813422 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 539/1061] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:29:57.735929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:57.737516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:57.745484 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:57.745941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:57.746755 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:57.747171 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:57.764031 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 HTTP/1.1 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:29:57.766154 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:57.769816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '3fa2b704-ec2f-48b8-b240-b8402aecb597'} Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:29:57.772300 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:57.775893 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:57.778551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:29:57.778551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-7393eacb-7026-441e-a082-99bcc96ad4b7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 404 len: 111 microversion: 2.1 time: 0.036485 Jun 17 07:29:57.778551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 523/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:57 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:29:57.783178 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-363ebb26-22d7-40ba-9a80-42b199dd1cff tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '.version_select at 0x7f8b6d39df70>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:57.805627 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-363ebb26-22d7-40ba-9a80-42b199dd1cff tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274471504" status: 202 len: 0 microversion: 2.1 time: 0.029308 Jun 17 07:29:57.806711 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 540/1063] 10.222.0.33 () {58 vars in 1217 bytes} [Fri Jun 17 07:29:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274471504 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:29:59.653529 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:59.654072 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:59.660823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:59.661275 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:59.662051 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:59.662496 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:59.677093 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 HTTP/1.1 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:29:59.678662 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.680436 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '3fa2b704-ec2f-48b8-b240-b8402aecb597'} Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:29:59.681269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.682664 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.684315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:29:59.684315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-97535340-0b37-4f12-baea-975f17e9c678 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 404 len: 111 microversion: 2.1 time: 0.030743 Jun 17 07:29:59.684315 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 524/1064] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:29:59 2022] DELETE /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:29:59.694047 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:29:59.695226 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 3fa2b704-ec2f-48b8-b240-b8402aecb597] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:29:59.709258 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:59.710032 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:59.711288 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:29:59.712054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:29:59.730858 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 HTTP/1.1 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:29:59.732554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.734221 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '3fa2b704-ec2f-48b8-b240-b8402aecb597'} Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:29:59.735163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. Jun 17 07:29:59.736908 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:29:59.738212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 3fa2b704-ec2f-48b8-b240-b8402aecb597 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:29:59.738212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e2dc110e-040b-4543-8e3d-51a74ed15744 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597" status: 404 len: 111 microversion: 2.1 time: 0.048617 Jun 17 07:29:59.738212 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 541/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:29:59 2022] GET /compute/v2.1/servers/3fa2b704-ec2f-48b8-b240-b8402aecb597 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:30:00.875614 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:00.876152 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:00.883331 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.883773 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.884550 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.884980 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.899463 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 HTTP/1.1 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:30:00.901030 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.902725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '8e6a9ab0-230d-4e55-9767-b821f0036ef3'} Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:00.903746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.905312 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.907016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:00.907016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-ac3a1c22-3acd-454f-a1ed-c4f6e215fb19 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 404 len: 111 microversion: 2.1 time: 0.030717 Jun 17 07:30:00.907016 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 525/1066] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:30:00 2022] DELETE /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:30:00.910976 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:00.911574 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 8e6a9ab0-230d-4e55-9767-b821f0036ef3] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:00.918426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.918871 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.919784 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.920399 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.934947 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 HTTP/1.1 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:30:00.936512 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.938204 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '8e6a9ab0-230d-4e55-9767-b821f0036ef3'} Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:00.939126 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. Jun 17 07:30:00.941317 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.943034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 8e6a9ab0-230d-4e55-9767-b821f0036ef3 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:00.943034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-42dd7434-6e83-4050-b910-5a2b3de468dc tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3" status: 404 len: 111 microversion: 2.1 time: 0.030848 Jun 17 07:30:00.943034 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 542/1067] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:00 2022] GET /compute/v2.1/servers/8e6a9ab0-230d-4e55-9767-b821f0036ef3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:30:00.947955 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:00.948578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:00.954947 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.955438 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.956217 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.956648 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.970752 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 HTTP/1.1 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:30:00.972962 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:00.974884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': 'c0db5765-c86f-4fac-9e92-ac1ff1147709'} Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:00.975884 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:00.977499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:00.979163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:00.979163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-68452814-a6a7-451e-8f8f-a7a32d6553e2 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 404 len: 111 microversion: 2.1 time: 0.031527 Jun 17 07:30:00.979163 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 526/1068] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:30:00 2022] DELETE /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:30:00.983425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:00.984089 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: c0db5765-c86f-4fac-9e92-ac1ff1147709] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:00.991123 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.991570 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:00.992363 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:00.992793 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:01.007723 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 HTTP/1.1 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:30:01.009285 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:01.011642 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'c0db5765-c86f-4fac-9e92-ac1ff1147709'} Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:01.012585 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. Jun 17 07:30:01.013909 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:01.015242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance c0db5765-c86f-4fac-9e92-ac1ff1147709 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:01.015242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3db4ea36-5258-4485-a621-8fbab1137fe7 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709" status: 404 len: 111 microversion: 2.1 time: 0.031054 Jun 17 07:30:01.015242 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 543/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:00 2022] GET /compute/v2.1/servers/c0db5765-c86f-4fac-9e92-ac1ff1147709 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:30:02.166125 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:02.166734 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:02.173249 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:02.173697 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:02.175005 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:02.175437 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:02.189297 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f HTTP/1.1 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:30:02.191431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.193039 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': '4dfd3a40-1403-42b7-a67e-0c3ba06d253f'} Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:02.193874 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.195468 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.197204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:02.197204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-1777e51b-7dc7-4ace-8c4a-175a1148252c tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 404 len: 111 microversion: 2.1 time: 0.030675 Jun 17 07:30:02.197204 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 527/1070] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:30:02 2022] DELETE /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:30:02.201268 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:02.201880 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] [instance: 4dfd3a40-1403-42b7-a67e-0c3ba06d253f] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:02.208522 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:02.208972 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:02.209732 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:02.210167 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:02.223797 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] HTTP exception thrown: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Request method failure captured: Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f HTTP/1.1 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCxcf17vL-VzENBZ04Xw8kItyKFmf4cJMh7y0Db-gleWDYN7nqFghPn_9AzUfB4X_LfnIYXeMCiZT67-6B6x2Ksu3UE4tO2C_Zn7lK3Php_OOf8MtmJTq3BPge0a_9N8U812J7sJNCVh6YiwoVFXMOTNS97RDsEAK_WFaIInUvRC6V8 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:30:02.225342 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9a7262e606264aba8be1c0008e93c0d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: 9a7262e606264aba8be1c0008e93c0d2 Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-204987314 Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: de859eecbef7498289f132a047e6e5f8 Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-AttachVolumeNegativeTest-204987314-project Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.227502 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '4dfd3a40-1403-42b7-a67e-0c3ba06d253f'} Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:30:02.228759 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. Jun 17 07:30:02.230397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:30:02.232055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] Returning 404 to user: Instance 4dfd3a40-1403-42b7-a67e-0c3ba06d253f could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:30:02.232055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-aa34266d-7a42-4352-b652-552e38ae1858 tempest-AttachVolumeNegativeTest-204987314 tempest-AttachVolumeNegativeTest-204987314-project] 10.222.0.33 "GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f" status: 404 len: 111 microversion: 2.1 time: 0.029303 Jun 17 07:30:02.232055 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 544/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:02 2022] GET /compute/v2.1/servers/4dfd3a40-1403-42b7-a67e-0c3ba06d253f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:30:51.877529 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-203604252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1704693656", "security_groups": [{"name": "tempest-secgroup-smoke-1395766797"}], "block_device_mapping_v2": [{"uuid": "0b963a54-f6ee-465f-a0d2-351dfe6b299e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "270f7e8d-fe10-476d-b957-559a5be577a9"}]}} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:30:51.886004 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=20 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:51.886658 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:52.055084 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.network.neutron [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] validate_networks() for [('270f7e8d-fe10-476d-b957-559a5be577a9', None, None, None, None, None)] {{(pid=117395) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 07:30:52.577395 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 07:30:52.577822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image limits 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 07:30:52.578295 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Flavor pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 07:30:52.578708 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Image pref 0:0:0 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 07:30:52.579121 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.virt.hardware [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117395) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 07:30:52.588858 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:52.589311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:52.590114 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:52.590550 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:52.608359 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 07:30:52.612560 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.quota [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Getting quotas for user 6a113fe9b988458d8e8898c5c9a8d02d and project d2b7ae6a418640629020f39ac455d075. Resources: {'ram', 'cores', 'instances'} {{(pid=117395) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 07:30:52.681796 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Going to run 1 instances... {{(pid=117395) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 07:30:52.683911 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b963a54-f6ee-465f-a0d2-351dfe6b299e',volume_size=None,volume_type=None)] {{(pid=117395) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 07:30:52.814478 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-172a3649-afbc-4afc-b1b8-9bd96b6d6e35 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.940985 Jun 17 07:30:52.815132 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 528/1072] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Jun 17 07:30:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 07:30:52.826527 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-c638e479-6c77-4557-9281-a1d0739198a1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:52.827119 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-c638e479-6c77-4557-9281-a1d0739198a1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:52.829397 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:52.830677 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:30:52.894473 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-c638e479-6c77-4557-9281-a1d0739198a1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:52.901517 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-c638e479-6c77-4557-9281-a1d0739198a1 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1094 microversion: 2.1 time: 0.079427 Jun 17 07:30:52.902084 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 545/1073] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:52 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 07:30:53.918269 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:53.918909 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:53.926531 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:53.927335 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:53.928157 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:53.928612 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:54.019850 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:54.029247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-72a93904-7d22-466a-8508-85ee08c0aa6b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1210 microversion: 2.1 time: 0.114246 Jun 17 07:30:54.030620 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 529/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:53 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:30:55.046844 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:55.047460 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:55.055097 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:55.055554 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:55.056614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:55.057054 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:55.219609 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:55.227513 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5a8fcd9a-5bb5-45b1-8fb2-baeaaedc16e6 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.184533 Jun 17 07:30:55.228332 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 546/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:55 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:30:55.798080 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [req-e30efd4d-f58d-4796-baf3-074dcbc2d162 req-dbaf12a6-be69-404a-a9d6-9c566545e488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6b6fea-bc45-497b-abd0-a9e6e89613ce", "tag": "40929b1e-92ea-47cc-8cab-85b41e6d6946"}]} {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:30:55.808374 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-e30efd4d-f58d-4796-baf3-074dcbc2d162 req-dbaf12a6-be69-404a-a9d6-9c566545e488 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:55.809140 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [req-e30efd4d-f58d-4796-baf3-074dcbc2d162 req-dbaf12a6-be69-404a-a9d6-9c566545e488 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:55.823323 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.compute.server_external_events [req-e30efd4d-f58d-4796-baf3-074dcbc2d162 req-dbaf12a6-be69-404a-a9d6-9c566545e488 service nova] Creating event network-changed:40929b1e-92ea-47cc-8cab-85b41e6d6946 for instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce on hv-cinder-83482 Jun 17 07:30:55.831951 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [req-e30efd4d-f58d-4796-baf3-074dcbc2d162 req-dbaf12a6-be69-404a-a9d6-9c566545e488 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200548 Jun 17 07:30:55.832690 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 530/1076] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:30:56.245253 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:56.246010 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:56.252606 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:56.253051 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:56.253823 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:56.254255 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:56.399491 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:56.407267 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-bf85ddda-a60d-4a9b-ba1c-714f1beb69e8 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.165840 Jun 17 07:30:56.407763 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 547/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:56 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:30:57.425214 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:57.425941 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:57.433265 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:57.433710 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:57.434481 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:57.434916 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:57.572978 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:57.582656 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-64c42e4b-82ca-4403-af50-b21c885ec6c3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.162097 Jun 17 07:30:57.583229 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 531/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:57 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:30:58.599452 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:58.600100 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:58.606812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:58.607189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:58.607952 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:58.608413 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:58.744337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:58.752006 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-9dd0d3c5-1687-4950-91c6-2e653334da87 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.156458 Jun 17 07:30:58.752610 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 548/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:58 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:30:59.769322 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:30:59.769958 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:30:59.776822 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:59.777268 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:59.778028 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:30:59.778466 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:30:59.917173 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:30:59.924921 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-d6a46444-bfe3-4b94-b684-b46b2212f892 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.159456 Jun 17 07:30:59.925597 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 532/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:30:59 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:00.942894 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:00.943503 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:00.950133 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:00.950579 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:00.951344 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:00.951780 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:01.086692 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:01.094189 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-8df9f332-c203-4f7d-b8de-9ca3571bc277 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.155279 Jun 17 07:31:01.094916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 549/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:00 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:02.110866 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:02.111464 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:02.118758 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:02.119206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:02.119976 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:02.120452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:02.254956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:02.263306 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-0ddd3c27-6c7f-4bb4-b9bb-582c36013572 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.156306 Jun 17 07:31:02.263869 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 533/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:02 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:03.280684 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:03.281310 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:03.283699 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell0:SELECT=2 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:31:03.289548 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:03.290004 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:03.290780 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:03.291219 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:03.433647 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:03.441448 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-a57130b8-e620-494a-8465-d079a958dd06 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.164477 Jun 17 07:31:03.442041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 550/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:03 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:04.458890 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:04.460089 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:04.462179 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=2 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:31:04.462859 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell0:SELECT=6 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:31:04.470068 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:04.470510 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:04.471373 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:04.471823 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:04.613793 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:04.622128 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-098b44dd-a5c1-4e39-8fc9-106086093766 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.167280 Jun 17 07:31:04.622714 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 534/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:04 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:04.810582 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-ff0aca62-8d69-4051-ae64-b65efd2423b9 req-4801e64d-d83b-45ef-bc1a-6b3327dddeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6b6fea-bc45-497b-abd0-a9e6e89613ce", "name": "network-vif-plugged", "status": "completed", "tag": "40929b1e-92ea-47cc-8cab-85b41e6d6946"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:31:04.820105 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ff0aca62-8d69-4051-ae64-b65efd2423b9 req-4801e64d-d83b-45ef-bc1a-6b3327dddeee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:04.820337 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ff0aca62-8d69-4051-ae64-b65efd2423b9 req-4801e64d-d83b-45ef-bc1a-6b3327dddeee service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:04.832210 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-ff0aca62-8d69-4051-ae64-b65efd2423b9 req-4801e64d-d83b-45ef-bc1a-6b3327dddeee service nova] Creating event network-vif-plugged:40929b1e-92ea-47cc-8cab-85b41e6d6946 for instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce on hv-cinder-83482 Jun 17 07:31:04.838085 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-ff0aca62-8d69-4051-ae64-b65efd2423b9 req-4801e64d-d83b-45ef-bc1a-6b3327dddeee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098532 Jun 17 07:31:04.838775 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 551/1085] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:31:05.639596 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:05.640162 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:05.646817 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:05.647266 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:05.648043 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:05.648522 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:05.786665 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:05.795382 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-f9f1160e-fad0-4644-b944-aeea78fddf25 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1266 microversion: 2.1 time: 0.159697 Jun 17 07:31:05.795956 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 535/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:05 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:06.814072 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:06.814751 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:06.822041 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:06.822519 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:06.823286 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:06.823715 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:06.956488 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:06.964916 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-91478312-497f-48fa-83ec-b807f70fc39b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1453 microversion: 2.1 time: 0.155733 Jun 17 07:31:06.965483 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 552/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:06 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:06.980816 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:31:06.981431 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:31:06.987990 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:06.988473 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:06.989247 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:06.990236 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:07.123119 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:31:07.132326 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-a3661bdc-4cb1-4880-982f-551a7755f172 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1453 microversion: 2.1 time: 0.155274 Jun 17 07:31:07.132903 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 536/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:31:06 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:31:09.051482 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-a14c4000-9700-4451-b540-85eba1265403 req-4e0429d0-1824-40c2-bcb4-e9b68e642843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6b6fea-bc45-497b-abd0-a9e6e89613ce", "tag": "40929b1e-92ea-47cc-8cab-85b41e6d6946"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:31:09.060319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-a14c4000-9700-4451-b540-85eba1265403 req-4e0429d0-1824-40c2-bcb4-e9b68e642843 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:31:09.060770 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-a14c4000-9700-4451-b540-85eba1265403 req-4e0429d0-1824-40c2-bcb4-e9b68e642843 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:31:09.072812 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-a14c4000-9700-4451-b540-85eba1265403 req-4e0429d0-1824-40c2-bcb4-e9b68e642843 service nova] Creating event network-changed:40929b1e-92ea-47cc-8cab-85b41e6d6946 for instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce on hv-cinder-83482 Jun 17 07:31:09.077614 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-a14c4000-9700-4451-b540-85eba1265403 req-4e0429d0-1824-40c2-bcb4-e9b68e642843 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085459 Jun 17 07:31:09.078287 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 553/1089] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:31:36.937929 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:31:36.938592 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Fri Jun 17 07:31:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:31:39.746621 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:31:39.747240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Fri Jun 17 07:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:32:36.818818 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:36.821608 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG dbcounter [-] [117395] Writing DB stats nova_cell1:SELECT=46 {{(pid=117395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:36.823705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_api:SELECT=20 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:36.824636 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG dbcounter [-] [117396] Writing DB stats nova_cell1:SELECT=40 {{(pid=117396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:32:36.826895 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:36.827516 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:36.829476 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-ffbaa619-1179-49b8-bf29-47e030e99312 req-76bbcd4f-36ab-4362-8710-0e98ddc82bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6b6fea-bc45-497b-abd0-a9e6e89613ce", "tag": "40929b1e-92ea-47cc-8cab-85b41e6d6946"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:32:36.835853 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:36.836568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:36.837444 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:36.837981 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:36.840707 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ffbaa619-1179-49b8-bf29-47e030e99312 req-76bbcd4f-36ab-4362-8710-0e98ddc82bc6 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:36.841154 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ffbaa619-1179-49b8-bf29-47e030e99312 req-76bbcd4f-36ab-4362-8710-0e98ddc82bc6 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:36.851980 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-ffbaa619-1179-49b8-bf29-47e030e99312 req-76bbcd4f-36ab-4362-8710-0e98ddc82bc6 service nova] Creating event network-changed:40929b1e-92ea-47cc-8cab-85b41e6d6946 for instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce on hv-cinder-83482 Jun 17 07:32:36.858039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-ffbaa619-1179-49b8-bf29-47e030e99312 req-76bbcd4f-36ab-4362-8710-0e98ddc82bc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036838 Jun 17 07:32:36.859364 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 554/1090] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:32:36.872488 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:32:36.965391 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-238c2a3a-d11c-45bf-9a64-6839d45700c9 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 204 len: 0 microversion: 2.1 time: 0.148339 Jun 17 07:32:36.969719 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 537/1091] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:32:36 2022] DELETE /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:32:36.974720 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:36.975433 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:36.982543 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:36.983249 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:36.984023 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:36.984494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:37.118605 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:37.126224 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-3113ca51-2628-4869-9b63-9f2ada90cfcd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1577 microversion: 2.1 time: 0.155680 Jun 17 07:32:37.126788 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 555/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:36 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:38.143311 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:38.144026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:38.151795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:38.152276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:38.153047 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:38.153482 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:38.347439 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:38.355515 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-bc988721-1f18-413d-89d8-5af1cea2fa57 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1577 microversion: 2.1 time: 0.216465 Jun 17 07:32:38.356130 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 538/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:38 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:39.002833 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-b82deeb5-54e1-4e1d-8ab8-f29f46fddbec req-0b875890-2303-4881-8584-164012282f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6b6fea-bc45-497b-abd0-a9e6e89613ce", "name": "network-vif-deleted", "tag": "40929b1e-92ea-47cc-8cab-85b41e6d6946"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:32:39.013700 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-b82deeb5-54e1-4e1d-8ab8-f29f46fddbec req-0b875890-2303-4881-8584-164012282f8b service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:39.014179 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-b82deeb5-54e1-4e1d-8ab8-f29f46fddbec req-0b875890-2303-4881-8584-164012282f8b service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:39.025826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-b82deeb5-54e1-4e1d-8ab8-f29f46fddbec req-0b875890-2303-4881-8584-164012282f8b service nova] Creating event network-vif-deleted:40929b1e-92ea-47cc-8cab-85b41e6d6946 for instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce on hv-cinder-83482 Jun 17 07:32:39.031886 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-b82deeb5-54e1-4e1d-8ab8-f29f46fddbec req-0b875890-2303-4881-8584-164012282f8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032720 Jun 17 07:32:39.032494 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 556/1094] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:32:39.374551 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:39.375179 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:39.390950 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:39.391499 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:39.392676 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:39.393190 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:39.430907 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:39.431429 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:39.432147 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lazy-loading 'fault' on Instance uuid 2c6b6fea-bc45-497b-abd0-a9e6e89613ce {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:32:39.487795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:39.487795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-adf4a570-0398-49c7-8f89-1a14ff5ef519 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 200 len: 1230 microversion: 2.1 time: 0.117894 Jun 17 07:32:39.487795 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 539/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:39 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:40.511431 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:40.512042 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 2c6b6fea-bc45-497b-abd0-a9e6e89613ce] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:40.518974 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:40.519425 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:40.520240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:40.520683 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:40.534877 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] HTTP exception thrown: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Request method failure captured: Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce HTTP/1.1 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCx1zvfe-8SXuEJ0lRTy-Wg7jL5NYFa95QJUTSH5Q1cJMSmQRA502ofsFTEA62zkUMiwFvCHKuY0Q_TyzL8n5-jAuzCVmrK6J67j6dkF4tUAOsI4PtUCMGK8BH--1OWHozuXgZpkHm3e4IU4dlAm7dLLiYd5uGW_-y7BsTY4Q24pRLM Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:32:40.536637 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2b7ae6a418640629020f39ac455d075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6a113fe9b988458d8e8898c5c9a8d02d Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. Jun 17 07:32:40.538407 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '2c6b6fea-bc45-497b-abd0-a9e6e89613ce'} Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:32:40.539963 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. Jun 17 07:32:40.541655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:40.543172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Returning 404 to user: Instance 2c6b6fea-bc45-497b-abd0-a9e6e89613ce could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:32:40.543172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-5af8c310-48ba-42c1-abce-87207b3931a3 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce" status: 404 len: 111 microversion: 2.1 time: 0.031039 Jun 17 07:32:40.543172 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 557/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:40 2022] GET /compute/v2.1/servers/2c6b6fea-bc45-497b-abd0-a9e6e89613ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:32:43.603288 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:43.604518 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:43.605595 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-98dce63b-a52f-4ddc-93bf-6b863e574366 req-b62be0f7-1409-4f42-b7c7-6d715ad11da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45bc2731-0299-4074-a682-9fd077b33e0b", "tag": "5f52cae1-9810-4adf-a88b-c23408fefe11"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:32:43.610791 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:43.611238 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:43.612008 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:43.612574 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:43.613926 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-98dce63b-a52f-4ddc-93bf-6b863e574366 req-b62be0f7-1409-4f42-b7c7-6d715ad11da2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:43.614375 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-98dce63b-a52f-4ddc-93bf-6b863e574366 req-b62be0f7-1409-4f42-b7c7-6d715ad11da2 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:43.628806 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-98dce63b-a52f-4ddc-93bf-6b863e574366 req-b62be0f7-1409-4f42-b7c7-6d715ad11da2 service nova] Creating event network-changed:5f52cae1-9810-4adf-a88b-c23408fefe11 for instance 45bc2731-0299-4074-a682-9fd077b33e0b on hv-cinder-83482 Jun 17 07:32:43.634737 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-98dce63b-a52f-4ddc-93bf-6b863e574366 req-b62be0f7-1409-4f42-b7c7-6d715ad11da2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032895 Jun 17 07:32:43.635571 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 558/1097] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 07:32:43.639416 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Going to try to terminate instance {{(pid=117395) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 07:32:43.748725 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-4e42e247-5788-423a-96fa-b1cc77b8ef56 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 204 len: 0 microversion: 2.1 time: 0.148375 Jun 17 07:32:43.751026 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 540/1098] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:32:43 2022] DELETE /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 07:32:43.763125 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:43.764655 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:43.772426 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:43.773319 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:43.774720 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:43.775446 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:43.921895 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.policy [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117396) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:43.929600 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-b7429bb9-281d-42a4-a078-09ee07eb7104 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1577 microversion: 2.1 time: 0.173670 Jun 17 07:32:43.930689 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 559/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:43 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:44.948362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:44.949068 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:44.955659 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:44.956134 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:44.956896 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:44.957325 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:45.125637 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:45.133886 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-91e3ba86-3113-4578-8d03-e3403811fadc tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1577 microversion: 2.1 time: 0.190542 Jun 17 07:32:45.134452 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 541/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:44 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:45.662649 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [req-ffff66da-0c47-41ae-b4b4-64c8813954bb req-c6ce67ed-ba87-4343-bfc5-2a3dd884df86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45bc2731-0299-4074-a682-9fd077b33e0b", "name": "network-vif-deleted", "tag": "5f52cae1-9810-4adf-a88b-c23408fefe11"}]} {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 07:32:45.674265 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ffff66da-0c47-41ae-b4b4-64c8813954bb req-c6ce67ed-ba87-4343-bfc5-2a3dd884df86 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:45.674705 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [req-ffff66da-0c47-41ae-b4b4-64c8813954bb req-c6ce67ed-ba87-4343-bfc5-2a3dd884df86 service nova] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:45.688012 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.compute.server_external_events [req-ffff66da-0c47-41ae-b4b4-64c8813954bb req-c6ce67ed-ba87-4343-bfc5-2a3dd884df86 service nova] Creating event network-vif-deleted:5f52cae1-9810-4adf-a88b-c23408fefe11 for instance 45bc2731-0299-4074-a682-9fd077b33e0b on hv-cinder-83482 Jun 17 07:32:45.693058 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [req-ffff66da-0c47-41ae-b4b4-64c8813954bb req-c6ce67ed-ba87-4343-bfc5-2a3dd884df86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034005 Jun 17 07:32:45.693653 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 560/1101] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jun 17 07:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 07:32:46.151705 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:46.152410 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:46.159262 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:46.159703 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:46.160498 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:46.160931 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:46.201857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:46.201857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:46.201857 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.objects.instance [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lazy-loading 'fault' on Instance uuid 45bc2731-0299-4074-a682-9fd077b33e0b {{(pid=117395) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 07:32:46.242699 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.policy [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a113fe9b988458d8e8898c5c9a8d02d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b7ae6a418640629020f39ac455d075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117395) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 07:32:46.250276 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-2a692f43-aec1-44d8-943c-de6d6239563b tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 200 len: 1230 microversion: 2.1 time: 0.103231 Jun 17 07:32:46.250839 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 542/1102] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:46 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 07:32:47.269046 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:47.269750 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: 45bc2731-0299-4074-a682-9fd077b33e0b] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:47.276590 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.277039 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.277802 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.278240 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.292036 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] HTTP exception thrown: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Request method failure captured: Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b HTTP/1.1 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCx1zvfe-8SXuEJ0lRTy-Wg7jL5NYFa95QJUTSH5Q1cJMSmQRA502ofsFTEA62zkUMiwFvCHKuY0Q_TyzL8n5-jAuzCVmrK6J67j6dkF4tUAOsI4PtUCMGK8BH--1OWHozuXgZpkHm3e4IU4dlAm7dLLiYd5uGW_-y7BsTY4Q24pRLM Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:32:47.293661 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2b7ae6a418640629020f39ac455d075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6a113fe9b988458d8e8898c5c9a8d02d Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. Jun 17 07:32:47.295361 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': '45bc2731-0299-4074-a682-9fd077b33e0b'} Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:32:47.296371 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. Jun 17 07:32:47.297906 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.299296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Returning 404 to user: Instance 45bc2731-0299-4074-a682-9fd077b33e0b could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:32:47.299296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-e0acebff-ec32-43d4-b64e-f3a2baaae9fd tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b" status: 404 len: 111 microversion: 2.1 time: 0.030221 Jun 17 07:32:47.299296 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 561/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:47 2022] GET /compute/v2.1/servers/45bc2731-0299-4074-a682-9fd077b33e0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:32:47.776192 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:47.777206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.compute.api [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117395) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:47.786362 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.786805 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.787568 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.788003 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG oslo_concurrency.lockutils [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.802364 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.wsgi [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] HTTP exception thrown: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Request method failure captured: Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: request: DELETE /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 HTTP/1.1 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept: application/json Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Accept-Encoding: identity Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Connection: close Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Length: 0 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Content-Type: application/json Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Host: 10.222.0.33 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Openstack-System-Scope: None Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: User-Agent: python-urllib3/1.26.9 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Auth-Token: gAAAAABirCx1zvfe-8SXuEJ0lRTy-Wg7jL5NYFa95QJUTSH5Q1cJMSmQRA502ofsFTEA62zkUMiwFvCHKuY0Q_TyzL8n5-jAuzCVmrK6J67j6dkF4tUAOsI4PtUCMGK8BH--1OWHozuXgZpkHm3e4IU4dlAm7dLLiYd5uGW_-y7BsTY4Q24pRLM Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Id: None Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Domain-Name: None Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Identity-Status: Confirmed Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Is-Admin-Project: True Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Id: default Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Domain-Name: Default Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Project-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Role: reader,member Jun 17 07:32:47.804060 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Roles: reader,member Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2b7ae6a418640629020f39ac455d075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Id: default Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Domain-Name: Default Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Id: 6a113fe9b988458d8e8898c5c9a8d02d Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: X-User-Name: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: method: > Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: exception: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.806324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: action_args: {'id': 'd47fec78-0275-4db6-a345-a4999f2863b4'} Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:32:47.807187 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.808770 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.810578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Returning 404 to user: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. {{(pid=117395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:32:47.810578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-31489b61-3a04-41ef-b72b-50859f1d5651 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 404 len: 111 microversion: 2.1 time: 0.037868 Jun 17 07:32:47.810578 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 543/1104] 10.222.0.33 () {58 vars in 1238 bytes} [Fri Jun 17 07:32:47 2022] DELETE /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 07:32:47.815128 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '>' {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:47.815739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.compute.api [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] [instance: d47fec78-0275-4db6-a345-a4999f2863b4] Fetching instance by UUID {{(pid=117396) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 07:32:47.822811 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.823470 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.824575 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 07:32:47.825227 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG oslo_concurrency.lockutils [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Lock "744af3b0-8bca-4736-b26d-6b2b0eb936d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 07:32:47.839644 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.wsgi [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] HTTP exception thrown: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Request method failure captured: Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: request: GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 HTTP/1.1 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept: application/json Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Accept-Encoding: identity Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Connection: close Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Length: 0 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Content-Type: application/json Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Host: 10.222.0.33 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Openstack-System-Scope: None Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: User-Agent: python-urllib3/1.26.9 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Auth-Token: gAAAAABirCx1zvfe-8SXuEJ0lRTy-Wg7jL5NYFa95QJUTSH5Q1cJMSmQRA502ofsFTEA62zkUMiwFvCHKuY0Q_TyzL8n5-jAuzCVmrK6J67j6dkF4tUAOsI4PtUCMGK8BH--1OWHozuXgZpkHm3e4IU4dlAm7dLLiYd5uGW_-y7BsTY4Q24pRLM Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Id: None Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Domain-Name: None Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Identity-Status: Confirmed Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Is-Admin-Project: True Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Id: default Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Domain-Name: Default Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Project-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Role: reader,member Jun 17 07:32:47.841199 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Roles: reader,member Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2b7ae6a418640629020f39ac455d075"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2b7ae6a418640629020f39ac455d075"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Id: d2b7ae6a418640629020f39ac455d075 Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-Tenant-Name: tempest-TestVolumeBootPattern-1920695887 Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Id: default Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Domain-Name: Default Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Id: 6a113fe9b988458d8e8898c5c9a8d02d Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: X-User-Name: tempest-TestVolumeBootPattern-1920695887-project Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: method: > Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: exception: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.842898 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: action_args: {'id': 'd47fec78-0275-4db6-a345-a4999f2863b4'} Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: {{(pid=117396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 07:32:47.843826 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. Jun 17 07:32:47.845408 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: ERROR nova.api.openstack.wsgi Jun 17 07:32:47.846739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: DEBUG nova.api.openstack.wsgi [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Returning 404 to user: Instance d47fec78-0275-4db6-a345-a4999f2863b4 could not be found. {{(pid=117396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 07:32:47.846739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO nova.api.openstack.requestlog [None req-18c2ca3d-29d4-4257-b2c2-4bd6d5e9fa3c tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4" status: 404 len: 111 microversion: 2.1 time: 0.031283 Jun 17 07:32:47.846739 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: [pid: 117396|app: 0|req: 562/1105] 10.222.0.33 () {58 vars in 1235 bytes} [Fri Jun 17 07:32:47 2022] GET /compute/v2.1/servers/d47fec78-0275-4db6-a345-a4999f2863b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 07:32:49.141206 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: DEBUG nova.api.openstack.wsgi [None req-6a39981c-f270-4edd-b266-bbd8066ecc99 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] Calling method '.version_select at 0x7f8b6d447820>' {{(pid=117395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 07:32:49.175914 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO nova.api.openstack.requestlog [None req-6a39981c-f270-4edd-b266-bbd8066ecc99 tempest-TestVolumeBootPattern-1920695887 tempest-TestVolumeBootPattern-1920695887-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1704693656" status: 202 len: 0 microversion: 2.1 time: 0.038489 Jun 17 07:32:49.176555 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: [pid: 117395|app: 0|req: 544/1106] 10.222.0.33 () {58 vars in 1262 bytes} [Fri Jun 17 07:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1704693656 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 07:33:04.876247 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:33:04.876712 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Fri Jun 17 07:33:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:33:14.869639 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:33:14.870324 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Fri Jun 17 07:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:34:59.755052 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:34:59.755686 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Fri Jun 17 07:34:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:35:10.067533 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:35:10.068190 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Fri Jun 17 07:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:35:19.462357 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:35:19.462960 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Fri Jun 17 07:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:36:24.885524 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:36:24.886163 dv-cinder-834822-4-iscsi devstack@n-api.service[117396]: Fri Jun 17 07:36:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 07:36:34.879178 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 07:36:34.879746 dv-cinder-834822-4-iscsi devstack@n-api.service[117395]: Fri Jun 17 07:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!